JOB  TRAINING  PARTNERSHIP  AQ:  JOB  COST, 

JOB  OUTCOME 


Y  4,6  74/7;  J  57/8 


Job  Training  Partnership  Act:   Job  C. 


HEARING 

BEFORE  THE 

EMPLOYMENT,  HOUSING,  AND  AVIATION 
SUBCOMMITTEE 

OF  THE 

COMMITTEE  ON 

GOVERNMENT  OPERATIONS 

HOUSE  OP  REPRESENTATIVES 

ONE  HUNDRED  THIRD  CONGRESS 

FIRST  SESSION 


APRIL  29,  1993 


Printed  for  the  use  of  the  Committee  on  Government  Operations 


'•^®&t;)*.. 


•  p'*^ 


U.S.  GOVERNMENT  PRINTING  OFFICE 
72-757  CC  WASraNGTON  :  1993 

For  sale  by  the  U.S.  Government  Printing  Office 
Superintendent  of  Documents,  Congressional  Sales  Office,  Washington,  DC  20402 
ISBN   0-16-0A1735-X 


7 

.  ~        JOB  TOAINING  PARTNERSHIP  AQ:  JOB  COST, 

JOB  OUTCOME 


Y  4,0  74/7;  J  57/8 


Job  Training  Partnership  Act:   Job  C. 


HEARING 

BEFORE  THE 

EMPLOYMENT,  HOUSING,  AND  AVIATION 
SUBCOMMITTEE 

OF  THE 

COMMITTEE  ON 

GOVERNMENT  OPERATIONS 

HOUSE  OP  REPRESENTATIVES 

ONE  HUNDRED  THIRD  CONGRESS 

FIRST  SESSION 


APRIL  29,  1993 


Printed  for  the  use  of  the  Committee  on  GJovemment  Operations 


U.S.  GOVERNMENT  PRINTING  OFFICE 
72-757  CC  WASHINGTON  :  1993 

For  sale  by  the  U.S.  Government  Printing  Office 
Superintendent  of  Documents,  Congressional  Sales  Office,  Washington,  DC  20402 
ISBN   0-1 6-041 735-X 


COMMITTEE  ON  GOVERNMENT  OPERATIONS 


JOHN  CONYERS, 
CARDISS  COLLINS,  Illinois 
GLENN  ENGLISH,  Oklahoma 
HENRY  A.  WAXMAN,  California 
MIKE  SYNAR,  Oklahoma 
STEPHEN  L.  NEAL,  North  Carolina 
TOM  LANTOS,  California 
MAJOR  R.  OWENS,  New  York 
EDOLPHUS  TOWNS,  New  York 
JOHN  M.  SPRATT,  JR,  South  Carolina 
GARY  A.  CONDIT,  Cahfomia 
COLLIN  C.  PETERSON,  Minnesota 
KAREN  L.  THURMAN,  Florida 
BOBBY  L.  RUSH,  Ilhnois 
CAROLYN  B.  MALONEY,  New  York 
THOMAS  M.  BARRETT,  Wisconsin 
DONALD  M.  PAYNE,  New  Jersey 
FLOYD  H.  FLAKE,  New  York 
JAMES  A.  HAYES,  Louisiana 
CRAIG  A.  WASHINGTON,  Texas 
BARBARA-ROSE  COLLINS,  Michigan 
CORRINE  BROWN,  Florida 
MARJORIE  MARGOLIES-MEZVINSKY, 

Pennsylvania 
LYNN  C.  WOOLSEY,  California 


Jr., 


Michigan,  Chairman 

WILLIAM  F.  CLINGER,  Jr.,  Pennsylvania 
AL  McCANDLESS,  California 
J.  DENNIS  HASTERT,  Illinois 
JON  L.  KYL,  Arizona 
CHRISTOPHER  SHAYS,  Connecticut 
STEVEN  SCHIFF,  New  Mexico 
C.  CHRISTOPHER  COX,  California 
CRAIG  THOMAS.  Wyoming 
ILEANA  ROS-LEHTINEN,  Florida 
RONALD  K.  MACHTLEY.  Rhode  Island 
DICK  ZIMMER,  New  Jersey 
WILLIAM  H.  ZELIFF,  JR.,  New  Hampshire 
JOHN  M.  MCHUGH,  New  York 
STEPHEN  HORN,  California 
DEBORAH  PRYCE,  Ohio 
JOHN  L.  MICA,  Florida 


BERNARD  SANDERS,  Vermont 
(Independent) 


JUUAN  Epstein,  Staff  Director 
Matthew  R.  Fletcher,  Minority  Staff  Director 


Employment,  Housing,  and  Aviation  Subcommittee 

COLLIN  C.  PETERSON,  Minnesota,  Chairman 

TOM  LANTOS,  California  RONALD  K.  MACHTLEY,  Rhode  Island 

BOBBY  L.  RUSH,  Illinois  CHRISTOPHER  SHAYS,  Connecticut 

FLOYD  H.  FLAKE,  New  York  JOHN  M.  McHUGH,  New  York 

KAREN  L.  THURMAN,  Florida 
BARBARA-ROSE  COLLINS,  Michigan 

Ex  Officio 

JOHN  CONYERS,  Jr.,  Michigan  WILLIAM  F.  CLINGER,  JR.,  Pennsylvania 

Edith  HollEMAN,  Staff  Director 
'   J ,      ,  ,"' .:  ■  ANDREA  NELSON,  Counsel 

.  '  I'  'X'  '    ■; .  , .  Lisa  PhiixjPS,  Professional  Staff  Member 

June  Saxton,  Clerk 


•■  v4*' 


Michael  D.  NaNNANI,  Minority  Professional  Staff 


■Ml  V  j'«-i-'.'i,>'^^*'' 


fir.r 


-r:\Ti^ 


(II) 


CONTENTS 


Page 

Hearing  held  on  April  29,  1993  1 

Statement  of: 

Crawford,  Clarence  C,  Associate  Director,  Employment  and  Education 
Issues,  Human  Resources  Division,  General  Accounting  Office,  accom- 
panied by  Thomas  Medvetz,  and  Sigurd  Nilsen  29 

Gerson,  Jon  A.,  director,  OfTice  of  Economic  Development,  Montgomery 
County,  MD  166 

Irving,  Patricia  E.,  president  and  CEO,  Private  Industry  Council  of  Phila- 
delphia, Philadelphia,  PA 142 

Masten,  Charles  C;.,  acting  inspector  general.  Department  of  Labor,  ac- 
companied by  Gerald  W.  Peterson,  assistant  inspector  general  for 
audit  4 

Orr,  Larry  L.,  project  director,  national  JTPA  study,  ABT  Associates, 
Inc 45 

Peterson,  Hon.  Collin  C,  a  Representative  in  Congress  from  the  State 
of  Minnesota,  and  chairman.  Employment,  Housing,  and  Aviation  Sub- 
conmiittee:  Opening  statement  1 

Struever,  William,  president,  Struever  Brothers,  Eccles  &  Rouse,  Balti- 
more, MD,  and  member,  Maryland  State  Governor's  Investment  Board  .        96 

Williams,  David  O.,  Deputy  Assistant  Secretary,  Employment  and  Train- 
ing Administration,  Department  of  Labor,  accompanied  by  Karen 
Greene,  Chief,  Division  of  Performance  Management  and  Evaluation; 
Hugh  Davies,  Director,  Office  of  Employment  and  Training  Program; 
Biyan  Keilty,  Administrator,  Office  of  Financial  and  Administrative 
Management;  and  Patricia  Wilkinson,  Grants  Management  Specialist, 
Office  of  Grants  and  Contract  Management 190 

Zeller,  John,  executive  director,  Montgomery  County  Private  Industry 

Council,  Montgomery  County,  MD  176 

Letters,  statements,  etc.,  submitted  for  the  record: 

Crawford,  Clarence  C,  Associate  Director,  Employment  and  Education 
Issues,  Human  Resources  Division,  General  Accounting  Office:  Pre- 
pared statement  32 

Gerson,  Jon  A.,  director.  Office  of  Economic  Development,  Montgomery 
County,  MD:  Prepared  statement 169 

Irving,  Patricia  E.,  president  and  CEO,  Private  Industry  Council  of  Phila- 
delphia, Hiiladelphia,  PA:  Prepared  statement  146 

Masten,  Charles  C,  acting  inspector  general,  Department  of  Labor:  Pre- 
pared statement  7 

Orr,  Larry  L.,  project  director,  national  JTPA  study,  ABT  Associates, 
Inc.:  Prepared  statement  49 

Struever,  William,  president,  Struever  Brothers,  Eccles  &  Rouse,  Balti- 
more, MD,  and  member,  Maryland  State  Governor's  Investment  Board: 
Prepared  statement  102 

Williams,  David  O.,  Deputy  Assistant  Secretary,  Employment  and  Train- 
ing Administration,  Department  of  Labor:  Prepared  statement 195 

Zeller,  John,  executive  director,  Montgomery  County  Private  Industry 
Council,  Montgomery  County,  MD:  Prepared  statement 179 

APPENDDCES 

Appendix  1. — Statement  of  Larry  G.  Buboltz,  director.  Rural  Minnesota  CEP, 

Detroit  Lakes,  MN  223 

Appendix  2. — Questions  for  the  record  submitted  by  Mr.  Machtley  '^41 


(III) 


JOB  TRAINING  PARTNERSHIP  ACT:  JOB  COST, 

JOB  OUTCOME 


THURSDAY,  APRIL  29,  1993 

House  of  Representatives, 
Employment,  Housing,  and  Aviation  Subcommittee 

OF  the  Committee  on  Government  Operations, 

Washington,  DC. 

The  subcommittee  met,  pursuant  to  notice,  at  9:40  a.m.,  in  room 
2247,  Raybum  House  Office  Building,  Hon.  Collin  C.  Peterson 
(chairman  of  the  subcommittee)  presiding. 

Present:  Representatives  Collin  C.  Peterson,  Bobl^  L.  Rush, 
Floyd  H.  Fl^e,  Karen  L.  Thurman,  Barbara-Rose  Collins,  and 
Ronald  K  Machtley. 

Also  present:  Edith  Holleman,  staff  director;  Andrea  Nelson, 
counsel;  Lisa  Phillips,  professional  staff  member;  June  Saxton, 
clerk;  and  Michael  D.  Nannini,  minority  professional  staff,  Commit- 
tee on  Government  Operations. 

OPENING  STATEMENT  OF  CHAIRMAN  PETERSON 

Mr.  Peterson.  The  subcommittee  will  come  to  order.  This  is  the 
first  in  a  series  of  subcommittee  hearings  into  whether  the  $11  bil- 
lion the  Federal  Government  spends  each  year  on  job  training  pro- 
grams actually  works  to  improve  the  lives,  levels  of  earnings,  and 
mture  employability  of  the  individuals  who  participate  in  the  pro- 
gnrams. 

Our  focus  today  is  on  the  Job  Training  Partnership  Act  which, 
at  nearly  $2  billion  per  year,  is  the  largest  single  Federal  job  train- 
ing program.  Recent  studies  of  the  effectiveness  of  JTPA  conclude 
that  standard  JTPA  programs,  with  their  traditional  priority  on 
placing  participants  in  a  job — any  job — do  not  have  much  effect  on 
the  level  of  earnings  or  future  employability  of  program  partici- 
pants. 

Testifying  about  their  reports  today  are  the  Labor  Department's 
Office  of  Inspector  General,  the  General  Accounting  Office,  and 
ABT  Associates — a  private  consultant  specifically  retained  by  the 
Labor  Department  to  evaluate  the  impact  of  JTPA  on  program  par- 
ticipants. 

We  will  also  hear  today  from  several  local  private  industry  coun- 
cils that  have  moved  aggressively  to  reverse  this  pattern  of  mini- 
mal results  through  innovative  strategies  such  as  carefully 
targeting  the  needs  of  local  employers  and  coordinating  training 
and  support  services  to  most  effectively  benefit  program  partici- 
pants. They  also  spend,  I  should  note,  two  to  three  times  more 

(1) 


money  per  participant  than  the  average,  according  to  the  ABT 
study. 

Testimony  from  the  Labor  Department  will  conclude  the  hearing. 
Top  career  staff  of  the  Employment  Training  Administration  will 
report  on  the  status  of  implementation  of  the  reforms  enacted  in 
the  1992  JTPA  amendments  and  will  respond  to  the  criticism 
raised  in  JTPA  studies. 

Do  any  members  have  opening  statements?  Mr.  Flake. 

Mr.  Flake.  Just  a  short  one,  Mr.  Chairman.  Thank  you  very 
much.  Good  morning. 

First  of  all,  let  me  thank  you  for  holding  the  hearing.  I  think  it 
is  important,  as  we  consider  the  plight  of  many  young  people 
throughout  this  land,  that  we  have  some  assessment  of  the  effec- 
tiveness of  the  job  training  program  which  is  aimed  at  meeting  the 
needs  of  many  disadvantaged  youth  and  adults. 

I  would  also  like  to  welcome  those  who  come  as  witnesses  this 
morning  before  this  committee  and  hope  that,  during  the  course  of 
the  hearing,  we  can  get  a  better  understanding  of  now  we  might 
better  and  more  effectively  serve  many  of  these  unemployed  youth. 

In  particular,  I  would  like  to  examine  whether  current  progprams 
are  successful  in  increasing  employment  and  increasing  the  oppor- 
tunities for  earnings  as  well  as  the  possibility  of  getting  young  peo- 
ple into  situations  where  they  can  develop  the  proper  work  ethic 
and  the  work  discipline  that  ultimately  leads  them  beyond  the 
starter  jobs  to  better  jobs. 

The  administration  has  already  proposed  putting  more  money 
into  this  program.  It  is  my  hope  that,  as  we  put  more  money  into 
the  progfram,  we  can  initially  have  a  better  sense  of  how  the  cur- 
rent progprams  work  and  how  we  might  better  spread  those  re- 
sources to  more  effectively  impact  the  job  market  as  a  whole. 

We  also  would  like  some  examination  of  what  happens  to  those 
workers  who  need  the  program  the  most,  because  there  has  been 
some  accusation  that  the  workers  who  need  the  least  assistance  are 
the  most  employable,  and  they  receive  more  benefits  sometimes 
from  the  program  than  those  who  do  not.  I  would  like  to  examine 
this  inequitv  and  ensure  that  the  unemployed  workers  receive  the 
assistance  that  they  need. 

Again,  I  would  like  to  thank  you  for  holding  this  hearing  and 
thank  those  who  have  come  as  witnesses  and,  hopefully,  we  can  all 
work  together  toward  the  end  of  providing  better  job  opportunities 
for  all  American  citizens. 

Thank  you,  Mr.  Chairman.  I  vield  back. 

Mr.  Peterson.  Thank  you,  \lr.  Flake.  That  was  a  fine  statement. 
Mr.  Machtley,  do  you  have  an  opening  statement? 

Mr.  Machtley.  Thank  you,  Mr.  Chairman.  I  look  forward  to 
working  with  you  on  this  subcommittee  as  we  hear  many  witnesses 
and  look  at  the  issues  that  are  important  to  this  country  and  par- 
ticularly to  our  future. 

I  want  to  thank  you  for  calling  this  particular  hearing  because 
I  think  that  job  training  is  essential  for  the  next  decade  and  prob- 
ably for  the  long-term  future  of  our  Nation, 

I  am  very  much  reminded  of  the  booklet  recently  written  by  Les- 
ter Thurow,  "Head  to  Head,"  which  points  out  that  the  competition 
is  not  between  our  States  in  the  future,  but  between  nations.  Those 


who  are  prepared  to  compete  will  be  successful.  Those  who  are  not 
prepared  to  compete  will,  in  fact,  find  their  standard  of  living  re- 
duced and,  obviously,  their  wages  reduced  at  the  same  time. 

Faced  with  this  obvious,  daunting  national  challenge  to  become 
more  productive,  I  believe  cooperation  is  necessary  in  all  areas  of 
education,  training,  and  the  continued  development  of  our  work 
force.  Workers  must  be  committed  to  high-quality  products  and 
services.  If  we  do  not  understand  the  term  "quality"  today,  I  am 
afraid  that  tomorrow  will  be  a  disaster. 

Educators  must  provide  our  workers  with  a  solid  foundation  in 
basic  skills  to  enable  workers  to  adapt  to  changing  technologies. 
The  most  recent  issue  of  Forbes  magazine  points  out  that  every 
employee  is  going  to  change  their  type  of  employment  perhaps  six 
to  seven  times  during  their  life  in  the  future. 

Employers  must  invest  in  work  training  and  coordinate  their  ac- 
tivities with  educators  and  workers  to  create  mutually  beneficial 
partnerships.  At  this  time,  the  Job  Training  Partnership  Act  serves 
as  the  primary  Federal-State  program  to  train  and  assist  individ- 
uals facing  various  barriers  to  employment. 

Some  barriers  can  be  easily  overcome,  such  as  not  knowing  how 
to  conduct  a  job  search.  Other  barriers,  however,  require  intensive 
and  individualized  attention,  such  as  lack  of  basic  math  and  read- 
ing skills.  Probably  homelessness  and  welfare  dependency  are 
going  to  be  more  difficult  to  combat. 

According  to  figures  which  we  will  hear  more  about  in  today's 
testimony,  approximately  36  million  people  face  some  type  of  em- 
ployment barrier  and  are  eligible  to  participate  in  Job  Training 
Partnership  Act  programs.  Tragically,  less  than  2.5  percent  of  the 
eligible  population  is  being  served. 

Moving  beyond  that  depressingly  low  figure,  we  will  also  hear 
that,  of  this  2.5  percent,  only  two-thirds  of  the  participants  are  suc- 
cessfully completing  their  training  and  finding  employment.  So  we 
have  2.5  percent  of  the  eligible  population  participating  and  only 
two-thirds  of  that  2.5  percent  are  completing  the  training  and  find- 
ing employment.  Obviously,  we  have  to  assess  whether  this  is  a 
successful  program  and,  if  not,  what  should  be  done. 

The  question  becomes,  how  do  we  best  accomplish  our  mutual 
goals  of  making  us  the  most  productive  Nation  for  the  future 
through  job  training  programs.  I  look  forward  to  hearing  the  testi- 
mony. 

Mr.  Peterson.  Thank  you,  Mr.  Machtley.  We  look  forward  to 
working  with  you  and  the  members  on  your  side  on  this  sub- 
committee. Mrs.  Thurman,  do  you  have  an  opening  statement? 

Mrs.  Thurman.  Briefly,  Mr.  Chairman.  I  also  appreciate  the  fact 
that  you  are  holding  these  hearings.  As  a  former  member  of  the  co- 
ordinating council  in  the  State  of  Florida  for  JTPA,  I  find  this  an 
exciting  time  and  certainly  one  that  will  renew  what  I  think  were 
the  objectives  for  the  Job  Training  Partnership  Act. 

I  refer  to  your  memo  that  was  sent  to  us,  and  I  specifically  hope 
that  we  look  not  only  at  where  some  problems  riddled  this  program 
but  where  the  successes  were,  because  I  think  we  have  some  chal- 
lenges for  the  future  for  this  country  based  on  where  our  necessary 
retraining  programs  are  going  to  have  to  be  looked  at,  particularly 


with  dislocated  workers,  especially  the  workers  that  will  be  dis- 
placed due  to  defense  spending  cuts. 

So  I  think  we  have  some  challenges  facing  us.  However,  I  think 
this  hearing  is  a  step  in  the  right  direction. 

Mr.  Peterson.  Thank  you,  Mrs.  Thurman. 

I  would  like  to  now  welcome  the  first  panel  of  witnesses,  and  I 
would  ask  that  the  members  reserve  their  questions  until  all  the 
witnesses  have  had  a  chance  to  speak. 

Mr.  Flake,  Mr.  Chairman,  before  you  do  that,  may  I  make  a 
unanimous-consent  request? 

Mr.  Peterson.  Sure. 

Mr.  Flake.  That  I  be  permitted  to  submit  to  the  committee  ques- 
tions. The  Banking  Committee  has  the  RTC  markup  at  this  hour, 
and  I  would  like  to  go  to  that,  but  I  would  like  unanimous  consent 
to  submit  questions. 

Mr.  Peterson.  Without  objection,  so  ordered. 

Mr.  Flake.  Thank  you. 

Mr.  Machtley.  Mr.  Chairman,  if  I  may,  may  all  members  have 
the  same  opportunity? 

Mr.  Peterson.  Yes,  we  will  extend  that  to  all  members,  and  if 
any  other  members  have  opening  statements,  we'll  make  those  a 
part  of  the  record  as  well. 

I  would  like  to  call  Mr.  Charles  Masten,  the  acting  inspector  gen- 
eral for  the  Department  of  Labor,  who  will  be  accompanied  by  Ger- 
ald Peterson,  assistant  inspector  general  for  audit;  and  Clarence 
Crawford,  the  Associate  Director  of  Employment  and  Education  Is- 
sues, Human  Resources  Division  of  the  GAO,  who  will  be  accom- 
panied, as  I  understand  it,  by  Sigurd  Nilsen  of  the  Human  Re- 
sources Division;  and  Larry  Orr,  the  vice  president  and  the  senior 
economist  for  ABT  Associates. 

Welcome  to  the  committee.  As  you  are  probably  aware,  it  is  our 
policy  to  swear  in  all  of  our  witnesses,  so  as  not  to  prejudice  any- 
body. So  if  you  would  rise. 

[Witnesses  sworn.] 

Mr.  Peterson.  I  would  like  to  welcome  you  all  to  the  subcommit- 
tee and  I  look  forward  to  hearing  your  testimony.  Your  full  state- 
ments will  be  made  a  part  of  the  record.  Feel  free  to  summarize 
your  remarks  and  hit  the  points  that  you  think  are  the  things  that 
are  the  most  important. 

We  would  like  to  try  to  keep  this  to  10  minutes  apiece.  The  mem- 
bers have  other  committees  and  there  are  a  lot  of  things  going  on 
this  morning,  so  we  are  going  to  try  to  move  this  along.  Again,  wel- 
come. Glad  to  have  you  with  us. 

STATEMENT  OF  CHARLES  C.  MASTEN,  ACTE^G  INSPECTOR 
GENERAL,  DEPARTMENT  OF  LABOR.  ACCOMPANIED  BY  GER- 
ALD  W.  PETERSON,  ASSISTANT  INSPECTOR  GENERAL  FOR 
AUDIT 

Mr.  Masten.  Mr.  Chairman  and  members  of  the  subcommittee, 
thank  you  for  inviting  me  to  testify  before  you  today  in  my  capacity 
as  acting  inspector  general  of  the  U.S.  Department  of  Labor.  As 
stated  earlier,  I  am  accompanied  by  Gerald  W.  Peterson,  who  is  the 
assistant  inspector  general  for  our  office  of  audit. 


At  your  request,  I  am  submitting  the  complete  text  of  my  state- 
ment for  the  record  and  will  keep  my  oral  presentation  short  to 
allow  ample  time  for  questions. 

I  have  been  asked  to  talk  about  the  results  of  a  recent  nation- 
wide audit  of  the  Job  Training  Partnership  Act — JTPA — program 
outcomes.  The  audit  specifically  covered  title  II-A,  disadvantaged 
adult  and  youth  training  programs,  for  program  year  1990. 

By  way  of  background,  Congress  appropriated  approximately 
$1.8  billion  in  1990  for  the  title  II-A  program.  The  funding  was 
used  to  serve  835,000  individuals,  or  about  2  percent  of  the  esti- 
mated 36  million  eligible  population. 

The  purpose  of  JTPA  is  to  "afford  job  training"  to  individuals 
"facing  serious  barriers  to  employment.  Thus,  our  audit  focused  on 
employment  barriers.  We  set  out  to  determine  whether  the  pro- 
gram operators  were  identifying  and  addressing  employment  bar- 
riers of  individuals  enrolled  in  the  program,  what  types  of  training 
and  supportive  services  were  provided,  what  the  costs  were,  and 
what  happened  to  the  participants  when  they  left  the  program. 

For  our  audit  purposes,  we  organized  emplo3rment  barriers  into 
three  categories:  Job  barriers,  educational  barriers,  and  personal 
barriers. 

Job  barriers  primarily  consisted  of  a  lack  of  job  skills,  job  search 
skills,  and  labor  market  information.  Educational  barriers  pri- 
marily consisted  of  school  dropouts  and  deficiencies  in  reading  and 
mathematics.  Personal  barriers  included  lack  of  child  care,  lack  of 
transportation,  and  disabilities. 

Employment  barriers  were  identified  for  93  percent  of  the  par- 
ticipants. The  employment  barriers  that  were  most  frequently  iden- 
tified and  addressed  concerned  individuals'  needs  for  occupational^ 
training,  job  search  assistance,  and  labor  market  information. 

Program  operators  also  identified  and  addressed  individual  needs 
for  supportive  services,  such  as  transportation  and  child  care. 
These  job  related  and  personal  circumstance  barriers  were  the 
types  of  barriers  Federal  job  training  programs  have  historically 
done  well  at  identifying  and  addressing. 

Program  operators  also  identified  numerous  educational  and  per- 
sonal barriers,  such  as  school  dropouts,  reading  and  math  defi- 
ciencies, health  problems,  disabilities,  and  substance  abuse.  About 
72  percent  of  the  participants  were  found  to  have  at  least  one  of 
these  barriers. 

However,  these  barriers  were  addressed  at  a  much  lower  rate 
than  the  barriers  related  to  job  skills.  For  example,  45  percent  of 
adult  participants  read  below  the  seventh  grade  level  but  only  27 
percent  of  those  received  help  from  JTPA  with  reading. 

Determining  the  total  investment  for  each  participant  was  im- 
possible. Financial  records  were  usually  not  maintained  on  a  par- 
ticipant basis.  When  we  were  able  to  identify  training  and  support- 
ive service  expenditures  by  participant,  the  average  investment 
was  about  $1,506  per  participant. 

Of  the  participants  who  left  the  progfram,  we  estimated  that  53 
percent  obtained  jobs;  14  percent  achieved  "employability  enhance- 
ments"— that  is,  completed  training  which  provided  the  potential 
for  employment;  33  percent  did  not  obtain  jobs  or  achieve  an  em- 
ployability enhancement. 


Of  the  participants  who  got  jobs,  49  percent  earned  wages  of  $5 
or  less;  49  percent  of  the  participants  interviewed  by  auditors  said 
they  found  their  jobs  without  JTPA  assistance. 

We  interviewed  approximately  54  percent  of  the  participants  who 
obtained  Jobs.  At  the  time  of  the  interview,  49  percent  were  still 
working  tor  their  original  employer;  26  percent  were  working  for 
another  employer;  5  percent  were  in  school  or  the  Armed  Forces; 
and  20  percent  were  unemployed. 

The  Confess  recognized  tnat  job  training  is  an  investment  in 
human  capital  and  not  an  expense.  The  act  states  that:  "The  basic 
return  on  investment  is  to  be  measured  by  increased  employment 
and  earnings  of  participants,  and  reductions  in  welfare  depend- 
ency." However,  analysis  of  the  audit  data  raises,  we  believe,  some 
serious  questions  about  the  expectations  placed  on  the  JTPA  title 
II-A  program. 

With  respect  to  the  1992  JTPA  amendments,  the  Office  of  Inspec- 
tor General  supported  the  stronger  accountability  provisions  in 
these  amendments.  We  believe  the  amendments  will  make  the  pro- 
gram more  fiscally  responsible. 

However,  the  amendments  will  not  solve  the  dilemma  faced  by 
the  job  training  system  in  carrying  out  its  legislative  mandate  with 
the  current  level  of  funding.  The  job  training  system  is  being  asked 
to  address  education  failures,  physical  dependencies,  and  emotional 
and  physical  disabilities  with  little  funding  and  no  demonstrated 
pattern  that  JTPA  can  successfully  treat  these  barriers. 

Mr.  Chairman,  this  completes  my  oral  presentation.  Thank  you 
for  giving  me  the  opportunity  to  make  this  statement.  Mr.  Peterson 
and  I  win  be  awaiting  your  questions. 

[The  prepared  statement  of  Mr.  Masten  follows:] 
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CHARLES  C.  MASTEN 
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SUBCOMMITTEE  ON  EMPLOYMENT,  HOUSING  AND  AVIATION 

COMMITTEE  ON  GOVERNMENT  OPERATIONS 

U.S.  HOUSE  OF  REPRESENTATIVES 

APRIL  29,  1993 


Mr.  Chairman  and  Members  of  the  Subcommittee: 

Thank  you  for  inviting  me  to  testify  before  you  today  in  my  capacity  as 
Acting  Inspector  General  of  the  U.S.  Department  of  Labor.    I  am  accompanied 
this  morning  by  Gerald  W.  Peterson,  Assistant  Inspector  General  for  Audit. 
My  comments  this  morning  do  not  necessarily  represent  the  viewpoints  of  the 
Department  of  Labor. 

I  have  been  asked  to  talk  about  the  results  of  a  recent  nationwide  audit  of 
Job  Training  Partnership  Act  (JTPA)  Program  Outcomes.   The  audit 
specifically  covered  Title  II-A,  disadvantaged  adult  and  youth  training 
programs,  for  program  year  1990. 

By  way  of  background,  Congress  appropriated  approximately  $1.8  billion 
in  1990  for  the  Title  II-A  program,  the  largest  of  the  JTPA  programs.    It  has 
been  estimated  that  over  36  million  people  were  eligible  to  be  served  by  the 
program  in  1990. 

Consequently,  JTPA  must  limit  its  coverage  and  provide  services  to 
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a  very  small  percentage  oi  the  eligible  population.    Thus,  the  program  served 
about  2.3  percent  of  the  eligible  population  in  1990,  that  is,  about  835,000 
individuals  participated  at  any  given  time  during  the  year  and  about  581,000 
exited  from  the  program. 

The  purpose  of  JTPA  is  to  "afford  job  training"  to  individuals  "facing 
serious  barriers  to  employment."   Thus,  our  "outcomes"  audit  focused  on 
employment  barriers.   The  audit  was  conducted  at  35  randomly  selected  local 
sites  called  service  delivery  areas  where  a  total  of  1,750  reported  terminations 
were  selected  for  review.   The  audit  results  were  projected  to  the  national 
universe  and  represent  estimates  of  program  activities  nationwide. 

Our  audit  objectives  were  to  determine  whether  program  operators  were 
identifying  and  addressing  employment  barriers  of  individuals  enrolled  in  the 
program;  what  types  of  training  and  supportive  services  were  provided;  what 
were  the  costs;  and  what  happened  to  the  participants  when  they  left  the 
program. 

For  our  audit  purposes,  we  organized  employment  barriers  into  three 
categories:  job  barriers,  educational  barriers,  and  personal  barriers.   Job 
barriers  primarily  consisted  of  a  lack  of  job  skills,  job  search  skills,  and  labor 
market  information.    Educational  barriers  primarily  consisted  of  school  dropouts 


auJ  deficiencies  in  reading  and  mathematics.    Personal  barriers  included  a  lack 
of  child  care,  transportation  and  disabilities. 

We  learned  that  not  all  the  program  terminations  were  correctly  reported. 
Of  the  581,000  terminated  participants  reported  by  ETA  for  Program  Year 
1990,  we  projected  that  at  least  18  percent  or  104,777  terminations  were 
improperly  reported. 

We  found  that  program  operators  identified  employment  barriers 
primarily  for  Department  of  Labor  reporting  purposes.    Further,  there  were  no 
standard  definitions  nor  guides  for  ranking  the  seriousness  of  the  barriers. 
Participants  were  often  evaluated  and  then  received  training  offered  by  the 
program  operator,  regardless  of  whether  the  training  addressed  the  individual's 
specific  needs. 

Employment  barriers  were  identified  for  93  percent  of  the  participants. 
Seventy-two  (72)  percent  of  the  participants  met  the  criteria  for  "hard-to-serve" 
clients  as  defined  in  the  September  1992  amendments  to  JTPA.   Since  the 
amendments  require  that  at  least  65  percent  of  participants  be  "hard-to-serve" 
clients,  the  program  was  already  enrolling  the  types  of  persons  targeted  by  the 
amendments. 

The  employment  barriers  that  were  most  frequently  identified  and 
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addressed  concerned  individuals'  needs  for  occupational  training,  job  seuich 
assistance,  and  labor  market  information.    Program  operators  also  identified  and 
addressed  individuals'  needs  for  supportive  services,  such  as  transportation  and 
child  care.   Federal  job  training  programs  have  historically  done  well  at 
identifying  and  addressing  these  types  of  job-related  and  personal  circumstance 
impediments  to  employment. 

Program  operators  also  identified  numerous  educational  and  personal 
barriers,  such  as  school  dropouts,  reading  and  math  deficiencies,  health 
problems,  disabilities,  and  substance  abuse.   About  72  percent  of  the 
participants  were  found  to  have  at  least  one  of  these  barriers.   However,  these 
barriers  were  addressed  at  a  much  lower  rate  than  the  barriers  related  to  job 
skills.   For  example,  45  percent  of  adult  participants  read  below  the  7th  grade 
level,  but  only  27  percent  of  those  received  help  from  JTPA  with  reading. 

Determining  the  total  investment  for  each  participant  was  impossible. 
Financial  records  were  usually  not  maintained  on  a  participant  basis.   Indirect 
costs  of  state,  SDA,  and  program  operator  administration  were  not  calculated 
on  a  participant  basis.    Likewise,  the  indirect  cost  for  in-house  training  or 
support  services  staff  were  not  accumulated  or  allocated  on  a  per  participant 
basis. 


11 

We  could  identify  direct  payments  made  ijr  training  and  assistance  in  78 
percent  of  our  sampled  participants,  and  the  average  investment  was  about 
$1,506  per  participant.    Sixty  percent  (60%)  of  payments  averaged  below 
$1,500;  46  percent  of  payments  averaged  below  $1,000. 

Of  the  participants  who  left  the  program,  we  estimated  that: 

•  53  percent  obtained  jobs. 

•  14  percent  achieved  "employability  enhancements,"  that  is, 
completed  training  which  provided  the  potential  for  employment. 

•  33  percent  did  not  obtain  a  job  nor  achieve  an  employability 
enhancement. 

Of  the  participants  who  got  jobs: 

•  49  percent  earned  wages  of  $5.00  or  less. 

•  49  percent  of  the  participants  interviewed  by  auditors  said  they 
found  their  jobs  without  JTPA  assistance. 

We  interviewed  approximately  54  percent  of  the  participants  who 
obtained  jobs.    At  the  time  of  the  interview: 

•  49  percent  were  still  working  for  their  original  employer. 

•  26  percent  were  working  for  another  employer. 

•  5  percent  were  in  school  or  the  Armed  Forces. 
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•  20  percent  were  unemployed. 

The  Congress  recognized  that  job  training  is  an  investment  in  human 
capital  and  not  an  expense.   The  Act  states  that  "the  basic  return  on  investment 
is  to  be  measured  by  increased  employment  and  earnings  of  participants,  and 
reductions  in  welfare  dependency."   Analysis  of  the  audit  data  raises,  we 
believe,  some  serious  questions  about  the  expectations  of  the  JTPA  Title  U-A 
program. 

We  believe  the  following  questions  need  to  be  answered  in  order  to 
clarify  the  expectations  of  JTPA: 

•  Is  the  current  network  of  state  and  local  operations  the  most 
efficient  and  effective  way  to  deliver  JTPA  services? 

•  Should  JTPA  expend  its  resources  to  provide  labor  exchange 
services  such  as  job  search,  labor  market  information,  and  job 
referral  services?  If  so,  what  is  the  role  of  the  U.S.  Employment 
Service  with  a  Fiscal  Year  1993  budget  of  approximately  $900 
million? 

•  Should  recruitment  and  placement  functions  be  independent  of 
training  to  prevent  the  program  operators  from  inflating 
performance  figures  by  servicing  only  job-ready  clients? 
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•  Should  JTPA  interventions  only  address  job  training  barriers  letting 
other  government  resources  address  educational  and  personal 
barriers? 

•  Should  JTPA  enroll  individuals  only  after  educational  and  personal 
barriers  have  been  eliminated  by  the  other  programs? 

•  Should  JTPA  expenditures  be  considered  "an  investment  in  human 
capital"  given  the  program's  limited  opportunity  to  create  value, 
i.e.,  increase  employment  and  earnings  and  reduce  welfare 
dependency? 

•  Should  the  success  of  the  JTPA  program  be  measured  differently? 

•  Should  JTPA  attempt  to  be  all  things  to  all  individuals  or  should  it 
assume  a  narrower  role? 

Mr.  Chairman,  this  completes  my  response  to  the  first  question  in  your 
April  13  letter.   I  would  like  to  respond  now  to  the  remaining  questions: 

1992  Amendments.   Overall,  the  Office  of  Inspector  General  supported 
the  stronger  accountability  provisions  in  the  1992  JTPA  amendments.    We 
believe  these  amendments  will  make  the  program  more  fiscally  responsible. 
However,  the  amendments  will  not  solve  the  dilemma  faced  by  the  job  training 
system  in  carrying  out  its  legislative  mandate  with  the  current  level  of  funding. 
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The  job  training  system  is  being  asked  to  address  education  failures,  physical 
dependencies,  and  emotional  and  physical  disabilities  with  insufficient  funding 
and  no  demonstrated  pattern  that  JTPA  can  successfully  treat  these  barriers. 

Performance  Measures.   You  asked  me  to  address  whether  placement 
rates  were  an  appropriate  measurement  of  program  success  and  to  give 
recommendations  for  revisions  or  clarifications.     In  Program  Year  1990,  the 
Title  n-A  adult  programs  were  measured  in  terms  of  an  individual's 
employment  rate  and  weekly  earnings  13  weeks  after  terminating  from  the 
program.   The  success  of  youth  programs  was  measured  in  terms  of  the  number 
of  youth  who  entered  employment  following  termination  and  the  rate  of  youth 
who  achieved  employ  ability  enhancements,  that  is,  completed  training  which 
provided  the  potential  for  employment.   These  "followup"  measures  for  adults 
were  established  in  1988  and  were,  in  part,  a  result  of  our  nationwide  audit  of 
Tide  UA  during  1986-87. 

In  an  audit  report,  issued  in  January  1988,  we  found  that  the  program 
was  successfully  achieving  a  70  percent  placement  rate.    On  the  other  hand,  the 
program  was  not  focusing  on  hard-to-serve  individuals.    Further,  the  rates  of 
retaining  participants  in  jobs,  increasing  their  earnings,  and  reducing  welfare 
dependency  were  not  encouraging.    We  concluded  that  the  70  percent  placement 
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rate  achieved  by  the  program  had  been  caused  by  the  performance  measures, 
which,  at  that  time,  emphasized  placement  rates.    In  order  to  improve  retention, 
increase  earnings,  and  reduce  welfare  dependency,  we  recommended  that  ETA 
develop  measures  and  standards  which  would  focus  the  system  on  providing 
training  which  influenced  longer-term,  more  stable  employment. 

In  establishing  the  "followup"  measures,  ETA  moved  toward  emphasizing 
longer-term  successes,  and  we  supported  these  changes.    However,  as  our 
report  pointed  out,  many  of  the  problems  with  JTPA  today  have  to  do  with 
unreasonable  expectations  for  the  amount  of  funding.    Although  we  would  like 
to  see  the  program  measured  in  terms  of  employment  barriers  addressed  and 
overcome,  we  believe  that  measures  should  not  be  changed  until  the 
expectations  of  the  program  are  clarified. 

Administrative  and  Financial  Accountability  Systems.  The  1982  JTPA 
statute  limited  administrative  spending  to  15  percent.  The  1992  amendments 
raised  the  limit  to  20  percent.  In  March  1992,  we  issued  an  audit  report  that 
compared  the  costs  reported  by  two  service  delivery  areas  to  costs  allocated  by 
auditors.  In  one  case,  the  auditor-allocated  administrative  costs  were  actually 
20  percent  higher  than  reported.  In  the  second  case,  the  administrative  costs 
were  12  percent  higher. 
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These  costs  were  not  inaccurately  reported,  however,  because  of 
regulations  issued  by  the  Employment  and  Training  Administration  in  1983 
These  regulations  provided  for  "single  unit  charging"  when  performance-based, 
fixed-unit-price  contracts  were  used.    In  other  words,  when  these  contracts 
were  used,  all  costs  could  be  charged  to  training  regardless  of  whether  they 
were  for  administration,  participant  support,  or  training.   This  regulatory 
provision,  which  we  believe  had  no  basis  in  law,  effectively  allowed  some 
entities  in  the  JTPA  system  to  get  around  the  15  percent  administrative 
limitation. 

OIG  strongly  supported  eliminating  this  practice,  and  the  1992 
amendments  restrict  the  "single  unit  charging"  of  all  costs  to  certain  tuition 
payments  only.   We  will  not  know  until  the  amendments  are  implemented 
beginning  in  July  1993  whether  these  changes  will  effectively  control  single  unit 
charging  and  ensure  better  compliance  with  the  20  percent  administrative  cost 
limitation. 

In  terms  of  accurate  cost-effectiveness  evaluations,  the  lack  of  uniform 
cost  principles  and  adequate  performance  and  outcomes  data  on  the  system 
precluded  meaningful  cost-effectiveness  evaluations  in  the  past.    However,  the 
1992  amendments  require  uniform  cost  principles,  including  adherence  to 
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generally  accepted  accounting  principles,  and  collection  of  more  data  on 
participants.   The  Employment  and  Training  Administration  is  in  the  process  of 
implementing  a  major  expansion  in  the  amount  of  data  collected  on  JTPA 
participants.   The  Standardized  Program  Information  Reporting  (SPIR)  system 
requires  states  to  maintain  socio-economic,  program  participation,  and  outcome 
information  on  each  participant  in  JTPA  Titles  HA,  IIC,  and  HI. 
Unfortunately,  the  outcome  information  does  not  include  information  on  an 
individual's  welfare  dependency  after  JTPA.   However,  the  SPER  system, 
coupled  with  more  consistent  cost  data,  will  greatly  enhance  the  ability  to 
determine  whether  JTPA  is  cost  effective. 

Remedial  Education  Requirements.   The  April  13  letter  contained  a 
question  about  the  Department's  implementation  of  the  1986  remedial  education 
requirements  under  JTPA.   These  requirements,  which  were  included  in  1986 
amendments  to  JTPA,  were  included  under  Title  UB,  the  Sunmier  Youth 
Employment  and  Training  Program.  This  program  differs  from  Title  HA, 
which  was  the  subject  of  our  JTPA  Program  Outcomes  audit,  which  I  have 
discussed  in  this  testimony.   According  to  the  Act,  the  purposes  of  the  summer 
youth  program  are  to: 

•        enhance  the  basic  educational  skills  of  eligible  youth, 
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•  encourage  school  completion,  or  enrollment  in  supplementary  or 
alternative  school  programs,  and 

•  provide  eligible  youth  with  exposure  to  the  world  of  work. 
The  Inspector  General's  Office  recentiy  issued  an  audit  report  on  the 

1992  Summer  Youth  Employment  and  Training  Program.   The  1992  program 

received  approximately  $1.2  billion  in  funding  consisting  of  $700  million  in 

regular  funding  and  $500  million  in  supplementary  funding. 

The  Inspector  General's  Office  reviewed  21  service  delivery  areas,  visited  over 

840  worksites,  and  interviewed  key  staff  and  over  1,200  participants  to 

determine  whether  the  work  experience  and  remedial  education  programs  were 

successful. 

We  found  that  the  work  experience  program  was  a  success.   Youth 
participants  were  productive,  interested,  and  closely  supervised.    However,  the 
remedial  education  program  was  a  limited  success.   There      -    :' 
were  several  problems: 

•  Although  participants  were  tested  at  all  the  SDAs,  coordination 
with  the  local  schools  did  not  always  occur. 

•  At  six  SDAs,  participants  were  not  assessed  to  determine  if  they 
needed  remedial  training,  as  required  by  the  Act. 
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•  While  reading  and  mathematics  training  was  provided  at  all  the 
SDAs,  the  term  "remediation"  also  included  courses  in  such 
subjects  as  history,  government,  economics,  algebra,  and  science. 

•  Most  of  the  21  SDAs  did  not  serve  those  most  in  need,  but  rather 
used  such  practices  as  giving  the  participant  the  option  to  attend 
remediation  or  providing  remediation  to  participants  only  in  certain 
locations  or  age  groups. 

Thank  you  for  giving  me  the  opportunity  to  make  this  statement.    We 
will  be  happy  to  take  your  questions  at  this  time. 
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MEMORANDUM  FOR:    CAROLYN  M.  GOLDING 

Acting  Assistant  Secretaiy  for 
.  Employment  and  Training 

FROM:  /dEkAlD  W.  PETERSON 

/  Assistant  Inspector  General 
for  Audit 


SUBJECT: 


Job  Training  Partnership  Act  (JTPA) 
Program  Outcomes 
Report  No.  09-93-201-03-340 


Attached  is  a  copy  of  our  final  report  on  participant  outcomes  resulting  from  the  Job 
Training  Partnerdiip  Act  Program.  We  conducted  the  audit  in  accordance  with  the 
Government  Auditing  Standards  (1988  revision),  as  established  by  the  Comptroller 
General  of  the  United  States. 

Our  audit  raises  questions  about  the  expectations  o(  the  JTPA  program.  It  would  be 
possible  to  conchide  the  program,  in  its  current  form,  may  never  achieve  the  goals  set 
forth  in  law  in  terms  of  increasing  employment  and  earnings  of  participants  and  reducing 
welfare  dependency.  This  dflenuna  has  prompted  us  to  pose  a  series  of  questions  which 
we  believe  should  be  answered  as  the  program  tries  to  implement  the  mandates  of  the 
September  1992  amendmeiitB. 

We  have  included  your  written  comments  to  our  draft  report  as  Appendix  D.  As  a 
result  of  your  comments  we  have  included  an  expanded  discussion  of  the  sampling 
methodology  (Appendix  A).  Also,  where  appropriate,  we  have  adjusted  specific  rep<Mt 
wording  based  on  your  comments. 

If  you  have  any  questions,  please  contact  me  at  219-8404.  S 
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Important  Information 


Data  in  this  report  reflects  a  national 
picture  of  the  JTPA  program.  Our 
sample  was  not  selected  to  be 
representative  of  individual  program 
operators,  service  delivery  areas,  or 
states. 

All  data  in  this  report  is  based  on 
projected  totals  of  properly  reported 
terminations.     Our  projectioris  are 
subject  to  a  3  percent  sampling  error 
at  the  95  percent  confidence  level. 
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EXECUTIVE  SUMMARY 


^™^^^^"'^^^^"      This  report  presents  the  results  of  our  Office  of  Inspector  General 
^"^  U*)TRODUCTION  (O^^)  nationwide  audit  of  Program  Year  1990  Job  Training 

Partnership  Act  (JTPA)  programs  funded  under  Title  II-A  of  the 
■■■■^^^^^^^^■"      Act   We  conducted  the  review  to  find  out  if  program  operators 

identified  and  eliminated  participants'  employment  barriers  and  to 

determine  what  happened  to  the  participants  when  they  left  the 

program. 

Congress  appropriated  $1.8  billion  to  fund  the  Program  Year  1990 
Title  II-A  program.   While  that  appears  to  be  a  substantial 
investment,  it  is,  in  fact,  relatively  insignificant.  For  that  same  time 
period,  the  Employment  and  Training  Administration  (ETA) 
estimated  that  over  36  million  people  were  eligible  to  be  served  by 
the  Title  II-A  program.  Per  capita,  only  $50  was  available  for  each 
eligible  person. 

Further,  the  legislation  requires  that  a  network  of  state  and  local 
operators  deliver  the  program.  Therefore,  the  $S0  was  further 
dilated  by  the  administrative  costs  associated  with  S9  tUttdr  trust 
territoiy  offices  and  636  service  delivery  area  (SDA)  offices.  ^  ETA 
has  estimated  that  over  18,000  fenoat  are  employed  by  the  state 
and^  SDA  offices.  Further,  there  is  a  private  industry  council  for 
each  of  the  636  SDA  offices.  Although  the  9,000  or  so  members  ol 
these  councik  serve  voluntarily,  travel,  meals,  and  other 
administrative  costs  are  paid  by  JTPA  FinaUy,  thousands  of 
contractors  participate  in  providing  training  and  services.  The 
number  of  oontractcM'  personnel  is  anknown,  bat  ETA  estimates 
start  at  20,000. 

Consequently,  JTPA  must  limit  its  coverage  and  provide  services  to 
a  very  small  percentage  of  the  eligible  popalatioo.  For  Program 
Year  1990  dw  program  repotted  serving  aboat  935,000.  individuals 
or  about  2J  percent  of  the  elig3>le  popalatjoa.  During  that  year 
about(.58M)00  persons  were  reported  as  terminating  from  the 
program. ' 


Oar  •MHtideatificd.kowewer,  that  aboM  18  perocat  of  dwte  reported  temiaatioos  were  iavaKd. 
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EXECUTIVE  SUMMARY 


We  found  program  operators  identified  and  provided  training  and 
assistance  to  eliminate  many  types  of  employment  barriers.  The 
barriers  most  often  identified  and  addressed  involved  the  need  for 
job  skills  or  help  in  searching  for  a  job.   In  most  cases,  program 
operators  identified  and  provided  interventions  to  help  individuak 
who  needed  occupational  training,  job  search  assistance,  and  labor 
market  information.  The  program  operators  also  identified  and 
addressed  individuals'  needs  for  supportive  services,  such  as 
transportation  and  child  care.  These  are  the  types  of  employment 
barriers  Department  of  Labor  training  programs  have  historically 
done  well  at  addressing. 

Conversely,  program  operators  also  identified  numerous  educational 
and  personal  barriers,  e.g.,  school  dropouts,  reading  and  math 
deficiencies,  health  problems,  disabilities,  and  substance  abuse. 
About  72  percent  of  the  participants  were  found  to  have  at  least 
one  of  these  barriers.   However,  the  program  operators  addressed 
these  barriers  at  a  significantly  lower  rate  than  job  skills  barriers. 
For  example,  45  percent  of  the  adult  participants  read  below  the  7th 
grade  level,  but  only  27  percent  of  those  received  help  from  JTPA 
with  their  reading  deficiencies. 

Determining  the  total  investment  for  each  participant  is  impossible. 
Financial  records  are  not  usually  maintained  on  a  participant  basis. 
Where  we  were  able  to  identify  training  and  assistance  expenditures 
for  participants,  the  average  investment  was  about  $1,500.  This  is 
not  surprising  considering  the  $1.8  billion  appropriation  spread 
among  the  835,000  participants  averages  ab<3ut  $2,150. 

Our  audit  found  the  1990  program  produced  the  following: 

•  53  percent  of  participants  obtained  jobs. 

•  14  percent  achieved  'employability  enhancements," 
i.e.,  completed  training  which  provided  the  potential 
for  employment 

•  ,  33  percent  did  not  obtain  a  job  or  attain  an 

employability  enhancement 
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However,  of  the  participants  who  got  jobs: 

•  49  percent  earned  wages  of  $5.00  or  less. 

•  49  percent  of  the  participants  interviewed  by  OIG  staff 
said  they  found  their  jobs  without  JTPA  assistance. 

We  interviewed  approximately  64  percent  of  the  participants  who 
obtained  jobs.  At  the  time  of  the  interview: 

•  49  percent  were  still  working  for  their  original 
employer. 

•  26  percent  were  working  for  another  employer. 

•  5  percent  were  in  school  or  the  Armed  Forces. 

•  20  percent  were  unemployed. 


We  also  contacted  the  emplt^eis  who  hired  JTPA  participants. 
Sixtv-five  percent  of  the  emploveis  we  coatacted  that  hii«d 
participants  aiter  receivingt  an  oa-the-j6b  trald&|^bsid^  stated  they 
ltd  have  Mred  the  person  without  the  JTPA'subsidy. 


■^"^^^^'""■^      Given  the  information  our  audit  developed,  one  might  conclude  the 
CONCLUSIONS  program,  in  its  current  form,  cannot  adueve'thfggiUsrsetfortii  ia 

>  law  in  terms  of  increasing  particq>ant  employmenrand  earnings  and 

U^^^^m^m^mmm     reducing  welfare  dependenqr-  Analysb  Of  the  aadh  data  raises,  we 
believe,  some  serious  questions  ilxwt  the  expectations  of  the  JTPA 
program.  The  job  training  ^stem  is  bei4g'ad(ed.i(?LaddRp 
education  faihires,  pl^ical  dejpeadende^  and  (SilOtf^ai  «mL 
physical  disabilities  with  little  finading  and  no  dcaliJC^ittatMl  pattein 
that  JTPA  ran  saoccssfuUy  Vu$  jdiese  banfaas 

This  dilemma  poses  several  questions  regarding  the  direction  the 
program  needs  to  take.  Therefore,  rather  than  making 
recommendations,  we  are  raising  what  we  believe  are  pertinent 
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questions  which  should  be  answered  as  the  program  tries  to 
implement  the  mandates  of  the  September  1992  amendments. 

Is  the  current  network  of  state  and  local  operators  the  most 
efScient  and  effective  way  to  deliver  JTPA  services? 

Should  JTPA  expend  its  resources  to  provide  labor  exchange 
services  such  as  job  search,  labor  market  information,  and  job 
referral  services?   If  so,  what  is  the  role  of  the  U.S. 
Employment  Service  with  a  budget  of  $850  million? 

Should  recruitment  and  placement  functions  be  independent 
of  training  to  prevent  the  program  operators  from  inflating 
performance  figures  by  serving  only  job-ready  clients? 

Should  JTPA  interventions  only  address  job  training  barriers, 
letting  other  government  resources  address  educational  and 
personal  barriers? 

Should  JTPA  enroll  individuals  only  after  educational  and 
personal  barriers  have  been  eliminated  by  the  other 
programs? 

Should  the  JTPA  expenditures  be  considered  "an  investment 
in  human  capital"  given  the  program's  limited  opportunity  to 
create  value,  i.e.,  increase  employment  and  earnings  and 
reduce  welfare  dependency? 

Should  the  success  of  the  JTPA  program  be  measured 
differently? 

Should  JTPA  attempt  to  be  all  things  to  all  individuals  or 
should  it  assume  a  narrower  role? 


This  report  contains  three  sections.   Section  I  contains  significant 
findings  from  the  data  gathered.  Section  II  contains  statistical 
tables.   Section  III,  separately  bound,  contains  a  histoiy  of  the  JTPA 
experiences  of  the  participants  studied  during  the  review. 
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Mr.  Peterson.  Thank  you,  Mr.  Masten.  We  appreciate  your 
being  with  us.  Mr.  Crawford. 

STATEMENT  OF  CLARENCE  C.  CRAWFORD,  ASSOCIATE  DIREC- 
TOR, EMPLOYMENT  AND  EDUCATION  ISSUES,  HUMAN  RE- 
SOURCES DIVISION,  GENERAL  ACCOUNTING  OFFICE,  AC- 
COMPANIED BY  THOMAS  MEDVETZ,  AND  SIGURD  NILSEN 

Mr.  Crawford.  Mr.  Chairman  and  members  of  the  subcommit- 
tee, we,  too,  are  pleased  to  be  here  today  to  discuss  with  you  the 
effectiveness  of  title  II-A  of  the  Job  Training  Partnership  Act  in 
meeting  the  employment  and  training  needs  of  the  economically 
disadvantaged. 

I  would  like  to  introduce,  on  my  immediate  right,  Mr.  Sigurd 
Nilsen  and  on  my  far  right,  Mr.  Thomas  Medvetz,  who  are  respon- 
sible for  much  of  our  work  in  this  area. 

Although  JTPA  is  the  Nation's  chief  federally  funded  employ- 
ment and  training  program,  it  is  but  one  of  many  programs  often 
operating  in  isolation  and  creating  a  difficult  maze  for  service  pro- 
viders and  those  who  are  in  need  of  assistance.  We  have  identified 
125  Federal  employment  and  training  programs,  including  JTPA, 
that  are  administered  by  14  departments  and  independent  agen- 
cies, spending  about  $16  billion  annually. 

In  summarizing  my  statement,  I  will  be  focusing  on  the  effective- 
ness of  JTPA,  the  likely  impact  of  recent  changes  to  JTPA,  and  im- 
provements needed  in  the  overall  Federal  response  to  employment 
and  training  needs  of  the  economically  disadvantaged.  My  testi- 
mony will  be  based  on  our  prior  and  ongoing  work  as  well  as  a  re- 
cent national  study  of  JTPA  prepared  for  the  Department  of  Labor. 

JTPA  is  viewed  as  a  relatively  successful  program  because  it  has, 
for  the  most  part,  met  or  exceeded  its  performance  standards  with 
an  overall  60  percent  placement  rate  for  those  who  complete  or 
leave  the  program.  Performance  standards  measure  how  well  local 
programs,  SDA's,  are  placing  people  in  jobs  and  at  what  wage,  but 
they  don't  provide  an  assessment  of  JTPA's  overall  impact  on  the 
people  it  is  serving. 

The  Labor  Department  contracted  with  MDRC  and  ABT  Associ- 
ates to  undertake  an  impact  evaluation  of  how  JTPA  normally  op- 
erates. The  interim  results  suggest  that  JTPA  may  not  be  effective 
for  youth  and  may  be  only  marginally  effective  for  adults.  We  are 
not  completely  surprised  by  the  ABT  findings,  given  the  results  of 
our  prior  work  and  the  fact  that  the  average  JTPA  participant  re- 
mains in  the  program  18  weeks. 

From  our  prior  work,  we  noted  that  SDA's  appeared  to  be  follow- 
ing a  low-risk  approach  to  serving  the  economically  disadvantaged. 
Those  who  were  least  ready  to  enter  the  job  market  were  provided 
the  least-intensive  services.  That  is,  they  were  less  likely  to  receive 
occupational  training  than  other  groups.  When  they  did  receive 
such  training,  they  received  fewer  training  hours  and  were  less 
likely  to  be  trained  in  higher-skilled  jobs. 

We  concluded  that  those  who  received  training  in  higher  occupa- 
tional skills,  regardless  of  how  job  ready  they  were,  tended  to  get 
better  jobs  than  those  who  received  other  training  services.  We  also 
noted  that  performance-based  incentive  services  can  encourage  em- 
ployers to  steer  certain  participants  into  low-wage  training. 
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A  major  premise  for  JTPA  and  other  training  programs  is  that 
services  provided  should  make  a  difference.  Since  the  ABT  study 
did  not  compare  alternative  service  approaches,  we  believe  that  ad- 
ditional impact  evaluations  are  needed  to  provide  policymakers 
with  information  on  how  best  to  serve  the  disadvantaged  and  to 
maximize  program  resources. 

Mr.  Chairman,  concerning  the  recent  changes  to  JTPA,  we,  too, 
agree  that  the  changes  will  help  to  improve  JTPA, 

First,  the  amendments  require  that  at  least  65  percent  of  those 
served  be  economically  disadvantaged  and  have  one  or  more  em- 
ployment barriers,  sucn  as  being  a  dropout  or  on  welfare. 

Second,  the  amendments  require  SDA's  to  not  only  objectively  as- 
sess the  needs  of  each  participant,  but  to  develop  and  implement 
an  individual  service  strategy. 

While  these  provisions  should  help,  we  still  believe  that  inde- 
pendent participant  assessments  are  needed  to  eliminate  the  poten- 
tial bias  that  exists  when  service  providers  with  vested  interests 
are  responsible  for  performing  these  assessments. 

Third,  the  recent  Labor  Department  initiative  to  expand  JTPA's 
data-collection  efforts  should  further  enhance  program  manage- 
ment. Expanded  information  on  participants  will  allow  program 
managers  to  better  determine  the  program  outcomes  achieved  from 
different  training  interventions  for  various  groups  of  individuals. 
Program  officials  can  also  use  the  data  to  help  make  regional  and 
State-level  comparisons  and  to  identify  locations  that  may  be  in 
need  of  technical  assistance. 

The  above  modifications  are  good.  However,  effective  implemen- 
tation is  critical.  Since  the  start  of  JTPA,  the  Labor  Department 
has  followed  a  hands-off  approach.  Our  previous  work  has  shown 
that  Labor's  passive  approach  has  resulted  in  program  inconsist- 
encies and  problems  going  undetected. 

For  example,  we  found  that,  in  some  SDA's,  administrative  costs 
exceeded  limitations  by  68  percent,  excessive  amounts  of  OJT — on- 
the-job  training  funds — were  approved  in  73  percent  of  the  low-skill 
contracts,  and  that  improper  or  unsupported  payments  were  made 
to  service  provides  in  two-thirds  of  the  SDA's  sampled. 

Mr.  Chairman,  concerning  the  need  for  a  comprehensive  Federal 
training  strategy,  JTPA  is  the  Federal  Government's  largest  em- 
ployment assistance  program  for  the  economically  disadvantaged, 
but  it  is  not  the  only  one.  Federal  efforts  to  upgrade  the  skills  of 
the  disadvantaged  are  carried  out  through  65  different  programs 
that  are  administered  by  13  departments  and  independent  agencies 
and  funded  at  over  $11  billion  annually. 

These  myriad  prom^ams  do  not  function  as  a  comprehensive,  co- 
hesive system,  but  often  operate  in  isolation.  We  are  currently  con- 
ducting several  studies  on  behalf  of  the  Congress  that  will  look  at 
some  of  these  issues. 

In  addition,  the  1992  amendments  to  JTPA  reflect  the  need  for 
coordination  by  establishing  State  resource  investment  councils 
that  are  aimed  at  coordinating  services  and  funds  for  programs 
such  as  JTPA,  adult  education,  and  the  jobs,  opportunities,  and 
basic  skills  programs.  However,  State  compliance  with  these  provi- 
sions is  voluntary  and  State  councils  on  vocational  education  may 
elect  not  to  participate. 
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Several  States  and  local  communities,  as  you  had  mentioned, 
have  undertaken  self-initiated  efforts  to  better  coordinate  and  more 
effectively  provide  services  to  those  who  are  in  need.  These  entities 
have  launched  their  initiatives  despite  substantial  barriers,  such  as 
conflicting  program  requirements,  differing  target  populations,  and 
staff  resistance. 

By  way  of  example,  the  State  of  Massachusetts  concluded  that  its 
35  Federal  employment  and  training  related  programs  were  operat- 
ing largely  in  isolation  and,  in  1988,  the  State  launched  an  effort 
to  address  this  problem. 

The  administration  has  proposed,  in  its  fiscal  year  1994  budget, 
a  strategy  based  on  the  concept  of  one-stop  career  centers.  While 
the  specifics  are  yet  to  be  identified,  this  concept  could  be  an  im- 
portant step  in  rationalizing  employment  and  training  assistance 
in  the  United  States. 

Mr.  Chairman,  this  concludes  my  testimony,  and  I  will  be  happy 
to  answer  any  questions  that  you  or  members  of  the  subcommittee 
may  have.  Thank  you. 

[The  prepared  statement  of  Mr.  Crawford  follows:] 
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SUMMARY  OF  TESTIMONY  BY  CLARENCE  C.  CRAWFORD 

JOB  TRAINING  PARTNERSHIP  ACT 

POTENTIAL  FOR  PROGRAM  IMPROVEMENTS  BUT  NATIONAL  JOB 

TRAINING  STRATEGY  NEEDED 

Title  IIA  of  the  Job  Training  Partnership  Act  (JTPA)  provides  job  training  and 
employment  seeking  skills  to  economically  disadvantaged  individuals  who  need 
training  and  other  labor  market  services  to  obtain  employment .    Although  JTPA  has 
been  viewed  as  relatively  successful  in  placing  participants  in  jobs ,  a  recent  study 
raises  questions  about  whether  the  program  is  as  effective  as  it  could  be .    In  our 
view,  the  effective  implementation  of  the  1992  amendments  to  JTPA,  coupled  with  an 
increased  emphasis  on  program  evaluation  and  a  national  strategy  to  eliminate 
confusion  and  duplication  among  the  myriad  training  programs,  could  substantially 
improve  the  program. 

JTPA  PERFORMANCE  AND  EFFECTIVENESS.    JTPA  has  consistently  placed  the 
majority  of  those  receiving  services  in  jobs  and ,  thus ,  generally  has  been  viewed  as 
successful.    However,  a  recent  study  indicates  that  the  progrtun  is  only  marginally 
increasing  the  earnings  and  employment  of  certain  client  groups  above  comparable 
nonparticipating  groups ,  and  thus  is  of  limited  effectiveness .    What  is  unknown  is 
which  training  services  make  the  greatest  difference  in  improving  the  employment 
opportunities  for  various  groups  of  participants .    Evaluations  are  needed  to 
determine  which  treatments  make  a  difference. 

RECENT  CHANGES  TO  JTPA.    The  1992  amendments  to  JTPA,  along  with  a 
Department  of  Labor  data  collection  initiative,  have  the  potentied  to  substsmtially 
improve  the  JTPA  program  by  providing  specific  guidance  on  program  targeting,  an 
objective  assessment  tmd  trtdning  plan  for  all  participants ,  and  more  meaningful  and 
comprehensive  data  on  prognun  operations.    However,  effective  implementation  of 
these  changes  is  critical  to  success.    In  so  doing,  Labor  should  assume  a  more  active 
role  than  it  has  taken  in  the  past  and  provide  detailed  guidance  to  ensure  that  the 
new  requirements  are  strictly  followed  and  use  its  expanded  data  system  to  better 
manage  the  program.    Labor  also  should  continue  to  fund  studies  aimed  at  assessing 
JTPA's  impact. 

NEED  FOR  A  NATIONAL  TRAINING  STRATEGY.    JTPA  is  one  of  65  federal  programs 
that  spent  over  $11  bilUon  in  fiscal  year  1991  on  employment  and  training  services  for 
the  economically  disadvantaged.    These  programs  do  not  function  as  a 
comprehensive,  cohesive  system,  but  often  operate  in  isolation.    Because  of  the 
myriad  programs,  the  effective  implementation  of  changes  to  JTPA  alone  will  not 
tissure  that  the  training  needs  of  the  economically  disadvantaged  are  addressed . 
Needed  is  an  overall  employment  and  training  strategy  at  the  federal  level  and,  at 
the  state  and  local  level,  a  streamlined  approach  to  eliminate  duplication  and 
confusion  and  ensure  efficient  and  effective  delivery  of  services.    In  this  respect, 
the  administration's  proposal  for  "one-stop  career  centers"  may  prove  to  be  an 
important  step  toward  rationalizing  employment  assistance  in  this  country. 
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Mr.  Chairman  and  Members  of  the  Subcommittee: 

We  are  pleased  to  be  here  today  to  discuss  with  you  the  effectiveness  of  title  IIA  of 
the  Job  Training  Partnership  Act  (JTPA)  in  meeting  the  employment  and  training 
needs  of  economically  disadvantaged  adults  and  youth.    Although  JTPA  is  the 
nation's  primary  federally  funded  employment  and  training  program ,  it  is  but  one  of 
many  programs  often  operating  in  isolation  and  creating  a  difficult  maze  for  service 
providers  emd  those  who  need  and  are  seeking  assistance.    We  have  identified  125 
federal  programs  that  are  administered  by  14  departments  or  independent  agencies , 
spending  over  $16  billion  smnuedly  providing  employment  and  training  services. 
Sixty-five  of  these  programs,  including  JTPA,  spend  about  $11  billion  to  serve  the 
economically  disadvantaged. 

My  testimony  today  will  focus  on  title  IIA  of  JTPA,  a  program  that  spends  about  $1.8 
billion  a  year  to  provide  employment  and  training  services  to  economically 
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disadvantaged  adults  and  youths .      I  will  also  be  focusing  on  the  effectiveness  of 
JTPA;  the  likely  impact  of  recent  changes  to  JTPA  on  its  effectiveness;  and 
improvements  needed  in  JTPA ,  as  well  as  in  the  overall  federal  response  to  the 
employment  and  training  needs  of  the  economically  disadvantaged .    My  testimony  is 
based  on  our  previous  and  ongoing  efforts  related  to  title  IIA  specifically,  and 
employment  and  training  programs ,  in  general ,  as  well  as  a  recent  national  study  of 
JTPA  prepared  for  the  Department  of  Labor .    These  efforts  indicate  that ,  although 
JTPA  has  been  relatively  successful  in  terms  of  the  number  of  participants  who  are 
initially  placed  in  jobs  upon  leaving  the  program ,  the  program  may  not  be 
substantiadly  improving  the  earning  potential  of  the  economically  disadvantaged  in 
this  country. 


^Letter  to  the  Chairman ,  Senate  Committee  on  Labor  and  Human  Resources 
(GAO/HRD-92-39R,  July  24,  1992). 

^The  act  also  includes  title  IIB,  a  summer  youth  employment  and  training  program, 
and  title  III,  an  assistance  program  for  dislocated  workers.    The  1992  amendments  to 
JTPA  transferred  year-round  services  for  youth  under  title  IIA  to  a  separate  youth 
program  under  a  newly  created  title  IIC. 
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However,  the  recently  enacted  amendments  to  JTPA  have  the  potential  to 
substantially  improve  the  delivery  of  employment  and  training  services  and  program 
outcomes,  if  they  are  effectively  implemented.    These  amendments  alone,  however, 
will  not  ensure  that  the  job  seeking  skills  and  employment  opportunities  of  the  most 
needy  are  enhanced .    Major  challenges  lay  ahead  for  the  Congress  and  the 
administration  in  addressing  the  multitude  of  employment  and  tredning  programs 
aimed  at  the  economically  disadvantaged.    Reducing  the  number  of  federal 
employment  and  training  programs  could  help  the  coordination  of  local  services ,  but 
it  is  unlikely  that  the  number  of  programs  will  be  significantly  reduced  any  time 
soon.    A  comprehensive,  overall  employment  and  training  strategy  that  fosters 
coordination  among  the  many  federal  programs  is  needed.    Such  a  strategy  should 
continually  seek  more  effective  methods  of  providing  services  to  the  economically 
disadvantaged  by  trying  alternative  approaches  and  evaluating  their  impact. 

BACKGROUND 

JTPA  title  IIA  provides  job  training  and  employment  seeking  skills  to  economically 
disadvantaged  individuals  who  need  training  and  other  labor  market  services  to 
obtain  employment.    It  has  been  funded  at  about  $1.8  billion  annually  since 
implementation.    Although  Labor  has  overaU  responsibility  for  the  program,  JTPA  is 
highly  decentraUzed,  with  most  participants  receiving  job  training  services  through 
programs  administered  by  the  56  states  and  territories  and  over  600  local  programs 
called  service  delivery  areas  (SDAs). 

SDAs  provide  employment  and  training  services  either  directly  or  through 
agreements  or  contracts  with  other  service  providers.    JTPA  services  include 
occupational  training  and  basic  education,  normally  provided  in  a  classroom  setting. 
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on-the-job  training  (OJT) ,  and  work  experience.     On  average,  participants  are  in 
the  program  about  18  weeks. 

Generally  speaking,  individuals  are  eligible  for  JTPA  if  they  are  economically 
disadvantaged—people  in  this  group  are  defined  primarily  by  household  income  but 
this  group  also  includes  welfare  and  food  stamp  recipients  and  the  handicapped .    In 
the  fall  of  1992,  the  first  comprehensive  reforms  to  JTPA  were  enacted  to  improve  the 
delivery  of  services  to  hard-to-serve  persons  as  well  as  to  make  other  program 
improvements.    Before  these  amendments,  the  act  provided  only  general  guidance  on 
how  the  program  was  to  be  targeted .    The  act  stated  that  services  were  to  be 
provided  "to  those  who  can  benefit  from,  and  who  are  most  in  need  of"  them,  and 
that  local  programs  are  to  "make  efforts  to  provide  equitable  services  among 
substantial  segments  of  the  eligible  population."   The  lack  of  specific  direction  led  to 
concern  among  some  in  the  employment  and  training  community  about  whether  JTPA 
was  serving  the  right  individuals  in  the  eligible  population.    The  1992  amendments 
provide  additional  direction  on  targeting  by  requiring  that  the  majority  of  funds  be 
targeted  on  hard-to-serve  individuals;  that  is,  those  with  specifically  listed  barriers 
to  employment ,  such  as  being  a  school  dropout  or  on  welfare . 

JTPA  is  a  performance- oriented  program.    The  act  requires  the  Secretary  of  Labor 
to  establish  national  performance  standards  sigainst  which  the  performance  of 
individual  SDAs  is  measured.    JTPA  provides  for  rewards  to  SDAs  that  exceed  these 
standards  and  for  sanctions  for  those  that  fail  to  meet  them  for  2  years .    For  the 
most  part ,  the  performance  standards  measure  the  extent  to  which  SDAs  place  all 
participants,  as  well  as  those  on  welfare,  in  jobs  and  the  wages  they  receive. 


^Work  experience  is  a  training  activity  consisting  of  short-term  or  part-time  work 
designed  to  develop  good  work  habits  and  basic  work  skills . 
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JTPA  PERFORMANCE  AND  EFFECTIVENESS 

JTPA  is  viewed  as  a  relatively  successful  program  because  the  majority  of  those  who 
participate  receive  a  job  upon  leaving  the  program .    Yet  a  recent  study    reuses 
questions  about  whether  the  program  is  effective;  that  is,  does  it  make  a  difference 
in  the  employment  and  earnings  of  those  who  were  assigned  to  participate . 
Beginning  with  the  first  full  year  of  program  operations  in  1984,  JTPA  has  placed 
over  60  percent  of  its  participants  in  jobs  each  year  and ,  with  few  exceptions ,  has 
met  or  exceeded  its  performance  standards  program-wide.    The  performance 
standards  measure  how  well  SDAs  are  placing  people  in  jobs  and  at  what  wage ,  at  one 
moment  in  time .     While  the  standards  provide  some  indication  of  performance  and 
short-term  program  outcome,  they  do  not  provide  an  assessment  of  the  program's 
overall  impact  on  the  people  it  is  serving. 

A  recently  released  study  of  JTPA  suggests  that  title  IIA  may  not  be  effective  for 
youth  participants  and  may  be  only  marginally  effective  for  adults .    The  Department 
of  Labor  contracted  with  MDRC  and  Abt  Associates  Inc .  to  undertake  an  impact 
evaluation  of  title  IIA  of  JTPA,  as  it  normally  operates.    Their  interim  results 
provide  some  measure  of  the  effects  of  JTPA  services  on  the  employment  and 


*The  National  JTPA  Study:  Title  IIA  Impacts  on  Earnings  and  Employment  at  18 
Months ,  Abt  Associates  Inc.  (Jan.  1993). 

^In  the  past ,  this  had  been  at  the  time  an  individual  left  the  program  but  more 
recently  this  was  changed  to  13  weeks  after  leaving  the  program. 

^Impact  refers  to  what  outcomes  JTPA  participants  achieve,  in  terms  of  employment 
and  wages,  as  compared  with  what  they  would  have  achieved  on  their  own,  without 
the  program .    Program  impact  can  be  measured  by  comparing  the  status  of  two 
identical  groups  of  people  whose  only  difference  is  that  one  group  enrolled  in  JTPA 
and  the  other  did  not .    The  use  of  an  evaluation  methodology  known  as  random 
assignment ,  in  which  eligible  individuals  are  randomly  assigned  to  receive  JTPA 
services  or  to  a  control  group  not  receiving  such  services ,  is  beUeved  to  yield  the 
most  accurate  estimate  of  program  impact . 
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earnings  outcomes  for  program  participants    when  compared  with  nonparticipants . 
The  study  results  indicate  a  modest  gain  in  earnings  for  adult  women  of  $539  for  an 
18-month  period  and  an  employment  geiin  of  a  little  over  2  percent.    The  earnings 
gain  for  adult  men  was  not  signif iceint ,  but  they  had  about  a  3  percentage  point 
employment  gain.    The  study  showed  that  out-of-school  male  youths  (16  to  21  years 

o 

old)  enrolled  in  JTPA  earned  $854  less  than  nonenroUees . 

We  were  not  completely  surprised  by  the  results  from  the  Abt  study,  given  the 

results  from  our  previous  work .    We  noted  that  the  SDAs  appeared  to  be  following  a 

g 
low-risk  approach  to  serving  the  economically  disadvantaged  .    Those  who  were  less 

ready  to  enter  the  job  market  were  provided  less  intensive  services ;  that  is ,  they 

were  less  likely  to  receive  occupational  treiining  than  other  groups .    When  they  did 

receive  such  training,  they  received  fewer  training  hours  and  were  less  likely  to  be 

trained  in  higher  skill  jobs .    Furthermore ,  they  were  as  apt  to  receive  only  job 

search  assistance  as  other  groups .    Because  training  costs  Ukely  increase  with  the 

intensity  of  services ,  it  appears  that  less  JTPA  funds  were  being  spent  on  behalf  of 

those  less  job  ready.    However,  we  concluded  that  those  who  received  training  in 

higher  skill  occupations ,  regardless  of  how  ready  they  were  to  enter  the  world  of 

work ,  tended  to  get  better  jobs  at  higher  wages  than  those  who  received  other 

tredning  services .    We  noted  in  another  study ,  on  racial  and  gender  disparities  in 

JTPA  services ,  that  performance-based  financial  incentives  can  encourage  service 

providers  to  steer  certain  participants  into  low-risk  training  and  away  from  higher 


'Findings  reported  from  the  Abt  study  refer  to  results  for  program  assignees ,  that 
is ,  those  for  whom  JTPA  services  were  made  available 

^Almost  all  of  the  negative  impact  on  earnings  is  concentrated  in  youth  who  reported 
having  an  arrest  record . 

Vob  Training  Partnership  Act:  Services  and  Outcomes  for  Participants  With 
Differing  Needs  {GAO/HRD-89-52,  June  9,  1989)  and  Job  Training  Partnership  Act: 
Youth  Participant  Characteristics,  Services,  and  Outcomes  (GAO/HRD-90-4GBR, 
Jan.  24,  1990). 
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risk  training  activities .       For  example ,  some  service  providers  are  reluctant  to 
train  women  in  nontraditional  occupations  because  of  higher  costs  and  higher  risks 
of  not  being  placed  in  a  job  upon  completion . 


A  major  premise  of  JTPA  or  any  training  and  education  program  is  that  the  services 
provided  will  make  a  difference.    Overall,  JTPA  appeared  to  only  marginally  improve 
employment  and  earnings  gains  for  certain  segments  of  those  it  served .    The  Abt 
study  did  not  compare  results  obtained  using  alternative  service  approaches  for  the 
hard-to-serve  population  that  is  targeted  by  JTPA.    Therefore,  the  analysis  cannot 
tell  which  services  work  best .    Given  that  billions  of  dollars  are  being  spent  annually 
on  the  economically  disadvantaged ,  it  is  important  to  know  definitively  which 
treatments  make  a  difference.    In  our  opinion,  such  information  is  essential  to 
policymakers  in  making  decisions  on  how  to  best  serve  the  disadvantaged  and  to 
maximize  program  resources.    Therefore,  additional  evaluations  of  the  program's 
impact  are  necessary. 

RECENT  CHANGES  TO  JTPA 

Key  provisions  of  the  recently  enacted  amendments  to  tJTPA ,  coupled  with  a  new  data 
collection  initiative  by  the  Department  of  Labor,  should  go  a  long  way  toward 
improving  JTPA.    These  modifications  will  address  program  shortcomings,  namely, 
(1)  the  lack  of  specific  guidance  on  whom  JTPA  should  target  for  services;  (2)  the 
need  for  objective  assessments  of  participants'  training  needs  and  developing  a  plan 
to  address  those  needs;  and  (3)  the  need  for  a  more  meaningful  and  comprehensive 
database  on  who  is  being  served,  the  services  they  get,  and  their  program  outcome. 
We  believe  that  these  changes  have  the  potential  to  improve  JTPA. 


^°Job  Training  Partnership  Act:  Racial  and  Gender  Disparities  in 
Services(GAO/HRD-91-148,  September  20,  1991). 
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The  amendments,  which  for  the  most  part  become  effective  July  1,  1993,  were  the 
first  comprehensive  modifications  to  the  program  since  its  implementation  in  1983. 
The  amendments  require  that  at  least  65  percent  of  those  served ,  in  addition  to  being 
economically  disadvantaged,  have  one  or  more  barriers  to  employment,  such  as  being 
a  school  dropout  or  on  welfare .    Our  previous  work  indicated  that  JTPA  was  not 
targeting  services  to  any  particular  group  and  those  with  the  greatest  need  for 
services  were  oftentimes  provided  the  least  amount  of  training  services .    The 
amendments  also  require  that  an  objective  assessment  of  the  skill  levels  and  service 
needs  of  each  participant  be  carried  out  and  that  an  individual  service  strategy  be 
developed  that  identifies  employment  goals ,  achievement  objectives ,  and  appropriate 
services .    These  provisions  should  help  ensure  that  the  program  emphasizes  services 
to  those  with  more  barriers  to  employment  («uid  presumably  a  greater  need  for  JTPA) 
and  that  the  services  they  receive  are  appropriate  for  them  to  succeed  in  the  labor 
market.    However,  we  believe  that  a  need  still  exists  for  independent  participant 
assessments  to  eliminate  the  potential  bifis  that  exists  when  service  providers,  with 
vested  interests  in  the  assessment  results,  are  responsible  for  performing  these 
evaluations . 

A  recent  Labor  initiative  to  expand  its  JTPA  data  collection  requirements  should 
further  enhance  program  management  by  enabling  Labor  to  accumulate  detailed 
information  on  the  scope  of  services  and  the  nature  of  employment  that  JTPA  is 
providing  to  its  participants ,  particularly  the  hard-to-serve .    Current  reporting 
requirements  provide  no  information  on  the  kinds  of  jobs  that  various  groups  of 
participants  receive  after  program  participation  or  the  nature  of  the  occupational 
training  and  supportive  services  that  may  have  contributed  to  different  outcomes . 
Labor's  expanded  data  system,  to  be  implemented  on  July  1,  1993,  will  provide 
program  officials  with  information  on  who  is  served  (in  terms  of  their  demographic 
characteristics  and  barriers  to  employment) ,  the  kinds  of  services  they  receive 
(including  the  number  of  hours  of  training) ,  and  their  outcome  at  progrcun 
termination  (including  their  specific  occupation,  if  placed  in  a  job) .    This 
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Information  will  allow  program  managers  to  determine  the  program  outcome  achieved 
from  different  training  interventions  for  various  groups  of  individuals .    Program 
officials  can  also  use  the  data  to  make  regional,  state,  and  local  level  comparisons 
and  make  judgments  about  SDAs  and  states  where  technical  assistance  may  be  needed 
to  improve  program  performance . 

While  the  above  modifications  are  designed  to  better  measure  and  monitor  program 
performance,  effective  implementation  of  these  changes  is  critical  to  success.    Since 
implementing  JTPA,  Labor  has  largely  followed  a  "hands  off"  approach  with  respect 
to  carrying  out  the  program,  and  has  assumed  a  role  of  providing  overall  policy 
guidance,  technical  assistance,  and  limited  oversight.    Our  previous  work  has  shown 
that  Labor's  passive  approach  has  allowed  SDAs  considerable  autonomy  and 
discretion  in  carrying  out  the  programs. -^^  While  there  may  be  some  advantages  to 
this  approach,  it  has  also  resulted  in  program  inconsistencies  and  problems  at  the 
state  and  local  level  going  undetected,  especially  with  respect  to  oversight  and 
monitoring  JTPA  program  operations.    For  example,  we  found  that  limits  on 
administrative  costs  were  circumvented,  excessive  amounts  of  OJT  were  approved, 
and  improper  or  xinsupported  payments  were  made  to  service  providers.    In  our 
view,  in  order  for  the  recent  changes  to  JTPA  to  be  fully  effective,  Labor  must  take 
a  more  active  role  in  their  implementation  by  providing  detailed  guidance  to  ensure 
that  the  new  requirements  are  strictly  followed  and  by  using  its  expanded  data 
system  to  better  manage  the  program.    This,  however,  should  not  be  viewed  as  a 
substitute  for  program  evaluation  and  Labor  should  continue  to  fund  studies  to 
assess  JTPA's  impact. 


"Job  Training  Partnership  Act:  Inadequate  Oversight  Leaves  Program  Vulnerable  to 
Waste.  Abuse,  and  Mismanagement  (GAO/HRD-91-97,  July  30,  1991). 
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NO  COMPREHENSIVE  FEDERAL  TRAINING  STRATEGY 
FOR  ASSISTING  THE  DISADVANTAGED 

JTPA  is  the  federal  government's  largest  employment  assistance  program  for  the 
economically  disadvantaged,  but  it  is  not  the  only  one.    Therefore,  the  effective 
implementation  of  changes  to  JTPA  alone  will  not  assure  that  the  training  needs  of 
the  economically  disadvantaged  are  addressed .    Federal  efforts  to  upgrade  the  skills 
of  disadvantaged  adults  and  out-of-school  youth  to  help  them  get  the  necessary 
skills  to  enter  the  mainstream  work  force  are  carried  out  through  65  different 
programs.    These  programs  are  administered  by  13  federal  departments  and 
independent  agencies,  with  funding  of  $11 .5  billion  in  fiscal  year  1991 .    These 
myriad  programs  do  not  function  as  a  comprehensive,  cohesive  system,  but  often 
operate  in  isolation .    Absent  at  the  federal  level  is  an  overall  employment  and 
training  strategy  that  coordinates  and  integrates  existing  programs .    Needed  at  the 
state  and  local  level  is  a  streamlined  approach  that  will  ( 1 )  eliminate  the  duplication 
of  services  and  the  confusion  among  the  disadvantaged  caused  by  the  current 
nonsystem  and  (2)  ensure  efficient  and  effective  delivery  of  services. 

We  have  ongoing  work  that  is  looking  into  several  aspects  of  the  multiple  employment 
programs  issue.    For  exeunple,  we  will  be  determining  the  extent  to  which  programs 
have  the  information  and  means  to  judge  their  effectiveness  and  whether  impact 
evaluations  have  been  performed.    Also,  we  are  looking  at  possible  barriers  to 
coordination  of  services  and  the  extent  to  which  employment  assistance  programs — 
which  may  be  adjuncts  to  other  programs  without  em  employment  assistance 
objective — are  duplicating  services  of  other  major  programs. 

The  1992  amendments  to  JTPA  recognize  the  need  for  coordination  by  establishing 
state  human  resource  investment  councils .    These  councils  are  aimed  at  coordinating 
the  provision  of  services  and  the  use  of  funds  for  humcm  resource  programs  such  as 
JTPA,  adult  education  programs,  and  the  Job  Opportunities  and  Basic  Skills 
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program.    However,  state  compliance  with  this  provision  is  voluntary,  and  the  state 
councils  on  vocational  education  may  elect  not  to  participate  in  such  councils. 

Several  states  and  local  communities  have  undertaken  self -initiated  efforts  in  an 
attempt  to  better  coordinate  and  more  effectively  provide  employment  assistance 
using  the  multiple  programs  available  within  their  boundaries .    These  entities  have 
launched  their  initiatives  despite  substantial  barriers  to  change,  such  as  conflicting 
program  requirements ,  differing  target  populations ,  and  staff  resistance .    In 
general,  the  approaches  are  designed  to  (1)  improve  access  to  services,  (2)  reduce 
client  confusion,  (3)  improve  independent  assessments,  (4)  reduce  duplication  of 
services,  and  (5)  improve  the  ability  to  track  clients. 

While  we  have  not  examined  these  efforts  in  detail,  they  appear  promising.    By  way 
of  example,  the  State  of  Massachusetts  concluded  that  the  35  job  training,  placement 
and  employment-related  education  programs  operating  in  the  state  were  running 
largely  in  isolation.    In  1988,  the  state  legislature  enacted  a  law  that  established  a 
two-tier  approach  to  service  simplification.    At  the  state  level,  it  established  a 
council  responsible  for  (1)  planning  the  use  of  program  resources  in  an  integrated, 
cohesive  manner;  (2)  determining  the  effectiveness  of  each  program  as  well  as  the 
system  as  a  whole;  and  (3)  making  the  system  more  responsive  to  the  needs  of 
business  and  program  trainees.    At  the  local  level,  16  regional  boards,  made  up  of 
representatives  from  the  education  £ind  employment  community,  were  established  to 
oversee  the  system's  implementation.    The  boards  operate  as  a  focal  point  for 
determining  which  programs  should  operate  within  their  region  and  how  the 
progreims  should  be  carried  out. 

We  believe  that  there  is  a  need,  especially  in  today's  climate  of  fiscal  constrsdnt,  for 
a  simplified  system  that  complements  and  supplements  the  common  goal  of  assisting 
the  economically  disadvantaged ,  limits  the  confusion  for  those  seeking  services ,  €ind 
eliminates  wasteful  federal  spending  for  duplicative  services .    Developing  a 
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coordinated  and  simplified  approach  will  require  a  look  at  how  federal  programs  could 
work  together  as  a  system  to  more  effectively  provide  employment  training  assistance 
to  the  disadvantaged. 

The  administration  has  proposed,  in  its  fiscal  year  1994  budget,  a  strategy  based  on 
the  concept  of  "one-stop  career  centers" .    While  information  on  the  proposal's 
specifics  is  not  yet  available ,  this  could  be  an  important  step  toward  rationalizing 
employment  assistance  in  the  United  States .    The  career  centers  would  serve  people 
in  need  of  career  counseling;  assessment;  occupational  information;  job  referral;  and 
training,  employment,  and  related  community  services.    They  would  offer  easier 
access  to  the  confusing  array  of  federal  programs  and  services  for  adults  seeking  to 
change  jobs  or  careers  or  to  upgrade  their  skills .    We  hope  this  will  turn  out  to  be  an 
initiative  that  can  substantially  improve  program  coordination  and  effectiveness . 


Mr.  Chairman,  this  concludes  my  testimony.    I  will  be  happy  to  answer  any  questions 
that  you  or  members  of  the  Subcommittee  might  have. 


(205250) 
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Mr.  Peterson.  Thank  you,  Mr.  Crawford.  Mr.  Orr. 

STATEMENT  OF  LARRY  L.  ORR,  PROJECT  DIRECTOR, 
NATIONAL  JTPA  STUDY,  ABT  ASSOCIATES,  INC. 

Mr.  Orr.  Mr.  Chairman,  members  of  the  committee,  I  am  Larry 
Orr  from  ABT  Associates,  a  private  research  firm  speciaHzing  in 
policy  research  and  program  evaluation.  I  am  very  pleased  to  be 
here  to  have  the  opportunity  to  speak  to  the  committee  about  our 
analysis  of  the  effects  of  JTPA  in  16  local  service  delivery  areas 
across  the  country. 

The  national  JTPA  study  provides  the  first  reliable  evidence  of 
the  impact  of  JTPA  on  the  educational  attainment,  emplo)rment, 
and  earnings  of  disadvantaged  youths  and  adults.  By  "impact,"  I 
mean  the  ^ains  or  losses  in  those  outcomes  that  resulted  from  par- 
ticipation m  the  program — what  might  be  termed  the  program's 
"value  added." 

We  measured  the  impacts  of  the  program  with  a  method  that  is 
very  similar  to  that  used  in  clinical  trials  of  new  drugs.  In  each 
SDA,  applicants  to  the  program  were  randomly  assigned  either  to 
go  into  the  program  or  to  go  into  a  control  group  that  was  excluded 
from  the  program. 

Random  assignment  assures  that  the  control  group  does  not  dif- 
fer from  the  program  participants  in  any  systematic  way  except 
that  they  were  not  allowed  access  to  the  program.  Therefore,  any 
subsequent  differences  in  outcomes  between  the  program  partici- 
pants and  the  control  group  can  be  confidently  attributed  to  the 
program. 

Suppose,  for  example,  that  average  earnings  in  the  control  group 
were  $10,000  and  average  earnings  of  the  participants  were 
$11,000.  Our  measure  of  impact  would  be  a  $1,000  earnings  gain. 

Random  assignment  is  widely  viewed  as  the  only  reliable  way  to 
measure  the  impact  of  employment  and  training  progprams.  For  this 
reason,  when  the  Department  of  Labor  set  out  to  evaluate  JTPA  in 
1986,  they  specified  random  assignment  as  the  method  of  choice. 
More  recently,  in  the  1992  JTPA  amendments,  the  Congress  speci- 
fied that  the  methods  to  be  used  to  evaluate  the  program  should 
include  random  assignment. 

It  is  important  to  note  that,  while  the  control  group  was  excluded 
fi-om  JTPA,  they  were  allowed  to  receive  any  other  education,  em- 
ployment, or  training  services  to  which  they  were  otherwise  enti- 
tled. Thus,  the  benchmark  against  which  we  measure  the  impacts 
of  JTPA  is  the  other  services  available  in  the  community,  not  the 
total  absence  of  services.  This  means  that  our  impact  estimates 
measure  the  incremental  impact  of  JTPA  over  and  above  the  effects 
of  other  services  the  participants  would  have  received  in  the  ab- 
sence of  the  program. 

This  study  is  based  on  a  sample  of  over  20,000  adults  and  out- 
of-school  youths  who  applied  to  JTPA  title  II-A  in  the  16  study 
sites  over  a  22-month  period  fi'om  1987  to  1989.  The  results  cur- 
rently available  follow  the  sample  for  18  months  after,  random  as- 
signment. 

We  performed  separate  analyses  for  adult  men,  adult  women, 
male  out-of-school  youths,  and  female  out-of-school  youths.  We  did 
not  study  in-school  youths.  Within  each  of  these  groups,  we  exam- 
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ined  the  experience  of  three  different  "service  strategy"  subgroups: 
Those  recommended  for  classroom  training  in  occupational  skills* 
those  recommended  for  on-the-job  training;  and  those  recommended 
for  less  intensive  services,  such  as  job  search  assistance,  basic  edu- 
cation, and  job-readiness  training. 

For  adults,  the  major  findings  were: 

First,  for  both  adult  men  and  adult  women,  JTPA  approximately 
doubled  the  rate  of  attainment  of  a  high  school  credential — that  is, 
either  a  high  school  diploma  or  a  GED — during  the  followup  period; 
second,  the  on-the-job  training  service  strategy  significantly  raised 
the  earnings  of  both  men  and  women.  We  estimate  that  the  pro- 
gram increased  the  earnings  of  adult  JTPA  enrollees  in  this  sub- 
group by  about  $900  per  year;  third,  the  classroom  training  service 
strategy  significantly  increased  the  earnings  of  adult  women  in  the 
post-program  period  but  had  no  statistically  significant  effect  on 
the  earnings  of  adult  men.  The  adult  women  in  this  subgroup  who 
enrolled  in  JTPA  experienced  annualized  earnings  gains  of  about 
$900  in  the  last  6  months  of  the  followup  period. 

Finally,  neither  the  women  nor  the  men  recommended  for  less  in- 
tensive services  experienced  any  statistically  significant  earnings 
gains  during  the  followup  period. 

For  out-o^school  youths,  the  principal  results  were: 

First,  the  program  increased  the  proportion  of  male  youths  who 
attained  a  high  school  credential  from  14  percent  of  all  dropouts  to 
24  percent.  Similarly,  it  raised  the  percentage  of  female  youths  re- 
ceiving a  high  school  credential  from  17  percent  of  all  female  drop- 
outs to  29  percent;  however,  the  program  had  no  statistically  sig- 
nificant positive  effects  on  the  earnings  of  any  of  the  youth 
subgfroups;  in  fact,  enrollment  in  JTPA  actually  reduced  the  earn- 
ings of  male  youths  recommended  for  on-the-job  training  and  less 
intensive  services  by  amounts  on  the  order  of  $1,200  to  $1,500  per 
year.  Further  analysis  revealed  that  these  earnings  losses  were  al- 
most entirely  concentrated  among  male  youths  who  reported  that 
they  had  been  arrested  prior  to  entry  into  the  program.  This  sub- 
group constituted  25  percent  of  the  male  youths  and  only  about  2 
percent  of  the  overall  sample. 

Overall,  then,  the  program  appears  to  have  had  positive  effects 
on  the  educational  attainment  of  all  demographic  subgroups;  mod- 
est positive  effects  on  the  earnings  of  adults,  especially  in  the  on- 
the-job  training  subgroup;  and  no  effect  on  the  earnings  of  youths, 
except  for  male  youths  who  had  been  arrested  prior  to  entry  into 
the  program,  whose  earnings  were  actually  reduced  as  a  result  of 
participating  in  the  program. 

In  viewing  these  results,  it  is  important  to  bear  several  things 
in  mind:  First,  the  16  study  sites  are  not  necessarily  representative 
of  the  Nation,  although  they  do  reflect  the  diversity  of  programs 
found  across  the  country;  second,  the  program  experience  on  which 
the  studv  is  based  occurred  in  1987  to  1989,  and  a  number  of 
changes  have  taken  place  in  the  program  since  that  time,  most  no- 
tably the  1992  amendments;  third,  our  results  are  restricted  to  the 
JTPA  titles  serving  disadvantaged  workers  and  our  sample  did  not 
include  in-school  youths;  and  fourth,  these  findings  cover  only  the 
first  18  months  after  program  entry.  Some  of  these  results  could 
change  with  longer  followup. 
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Finally,  it  will  be  important  to  consider  these  progpram  impacts 
in  relation  to  the  costs  of  the  program.  In  our  final  report  to  be  re- 
leased later  this  year,  we  will  extend  the  followup  period  to  30 
months  and  will  present  a  comprehensive  analysis  of  program  costs 
as  well  as  benefits. 

The  national  JTPA  study  was  designed  to  measure  the  effects  of 
JTPA  as  it  normally  operates  in  order  to  identify  those  parts  of  the 
program  that  are  performing  well  and  those  that  are  not.  We  be- 
lieve that  the  study  was  successful  in  doing  this. 

The  study  was  not  designed  to  tell  us  how  to  improve  the  pro- 
gfram.  To  do  that  would  have  required  testing  new  service  ap- 
proaches. That  would  have  changed  the  way  the  progn*am  operated 
and  nm  counter  to  the  objective  of  evaluating  the  program  as  it 
normally  operates. 

Thus,  I  cannot  tell  you  today  how  to  make  the  program  work  bet- 
ter for  out-of-school  youths  or  for  adults  currently  receiving  less  in- 
tensive services.  What  I  can  tell  you  is  that  these  are  the  areas  in 
which  efforts  to  improve  the  program  should  focus. 

In  order  to  decide  what  should  be  done  in  these  areas,  I  strongly 
recommend  further  research  along  the  following  lines. 

First,  I  recommend  that  the  Department  of  Labor  look  very  close- 
ly at  the  way  the  JTPA  serves  male  youths  with  an  arrest  record, 
in  order  to  attempt  to  discover  why  the  program  is  having  an  ad- 
verse effect  on  this  group. 

Second,  I  recommend  that  alternative  methods  of  serving  adults 
currently  receiving  nonintensive  services  and  all  youths  be  devel- 
oped and  rigorously  evaluated.  I  cannot  overstate  the  importance 
of  rigorous  evaluation  of  new  approaches  to  serving  these  groups. 
Experience  has  demonstrated  that  simply  trying  out  alternative 
program  strategfies  without  rigorous  evaluation  is  not  enough. 
Nearly  10  years  ago,  a  National  Academy  of  Sciences  committee  re- 
viewed some  400  reports  on  a  wide  range  of  youth  employment  and 
training  demonstrations  and  concluded:  "Despite  the  magnitude  of 
the  resources  ostensibly  devoted  to  the  objectives  of  research  and 
evaluation,  there  is  little  reliable  information  on  the  effectiveness 
of  the  programs  in  solving  youth  employment  problems."  I  would 
submit  that  that  statement  is  still  true  today. 

Finally,  in  order  to  continuously  monitor  the  effectiveness  of  the 
program  and  to  determine  whether  any  of  the  changes  in  the  pro- 
gn'am  since  the  period  we  studied  have  substantially  changed  the 
effects  of  the  program,  it  is  important  to  periodically  evaluate  the 
existing  program,  using  methods  similar  to  those  used  in  the  na- 
tional JTPA  study.  In  this  connection,  I  should  note  that  the  De- 
partment of  Labor  has  already  issued  a  request  for  proposals  for 
a  follow-on  study.  I  would  hope  that  this  study  could,  in  some 
measure,  address  all  of  the  issues  I  have  mentioned. 

I  realize  that  the  Congress  does  not  have  the  luxury  of  waiting 
several  years  for  more  research  to  be  conducted,  but  must  act  now 
on  the  best  available  information.  At  the  same  time,  I  think  it  is 
important  to  invest  in  getting  better  evidence  so  that  when  these 
same  issues  arise  5  or  10  years  from  now,  we  are  in  a  better  posi- 
tion to  address  them. 
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Mr.  Chairman,  I  want  to  thank  you  again  for  the  opportxinity  to 
tell  you  about  the  national  JTPA  study.  Copies  of  a  more  detailed 
summary  of  the  study  are  available,  and  I  would  be  glad  to  respond 
to  any  questions. 

[The  prepared  statement  of  Mr.  Orr  follows:] 
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I'm  Larry  Orr,  from  Abt  Associates.  I  am  very  pleased  to  have  this  oppoitunity  to  speak 
to  the  Committee  about  our  analysis  of  the  effects  of  Job  Training  Paitnershq)  Act  (JTPA) 
prognuns  in  sixteen  local  Service  Delivery  Areas  (SDAs)  across  the  country.' 

The  National  JTPA  Study 

The  National  JTPA  Study  provides  the  first  reliable  evidence  of  the  impact  of  JTPA  on 
the  educational  attaiimient,  employment,  and  earnings  of  disadvantaged  youths  and  adults.  By 
"impact",  I  mean  the  gains  or  losses  in  these  outcomes  that  resulted  from  participation  in  the 
program—what  might  be  termed  the  program's  "value  added". 

We  measured  the  impacts  of  the  program  with  a  method  that  is  very  similar  to  that  used 
in  clinical  trials  of  new  drugs.  In  each  SDA,  iq)plicants  to  the  program  were  randomly  assigned 
either  to  go  into  the  program  or  to  go  into  a  control  group,  which  was  excluded  from  the 
program.  Random  assignment  assures  that  the  control  group  does  not  differ  from  the  program 
participants  in  any  systematic  way  except  that  they  do  not  have  access  to  the  program. 
Therefore,  any  subsequent  difference  in  outcomes  between  the  program  participants  and  the 
control  group  can  be  confidently  attributed  to  the  program.  Suppose,  for  example,  that  average 
earnings  in  the  control  group  were  $10,000  and  the  average  earnings  of  participants  were 
$11 ,000.   Our  estimate  of  the  impact  of  the  program  would  be  a  $1 ,000  earnings  gain. 

Random  assigimient  is  widely  viewed  as  the  only  reliable  way  to  measure  the  impact  of 
employment  and  training  programs.  For  this  reason,  when  the  Dq)artment  of  Labor  set  out  to 
evaluate  JTPA  in  1986,  they  specified  random  assignment  as  the  method  of  choice.  More 
recently,  in  the  1992  JTPA  amendments.  Congress  specified  that  the  methods  to  be  used  to 
evaluate  the  program  should  include  random  assigmnent. 

It  is  important  to  note  that,  while  the  control  group  was  excluded  from  JTPA,  they  were 
allowed  to  receive  any  other  education,  employment,  or  training  services  to  which  they  were 
otherwise  entitled.  Thus,  the  benchmark  against  which  we  measure  JTPA  is  the  other  services 


'    The  National  JTPA  Study  was  conducted  by  Abt  Associates  and  the  Mao|>ower  Demonstntion  Research 
Corporation,  under  contract  to  the  U.S.  Department  of  Labor. 
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available  in  the  community,  not  the  total  absence  of  service.  This  means  that  our  impact 
estimates  measure  the  incronental  effects  of  JTPA,  over  and  above  the  effects  of  services  the 
participants  would  have  received  in  the  absence  of  the  program. 

This  study  is  based  on  a  sample  of  over  20,000  adults  and  out-of-schoo!  youths  who 
applied  to  JTPA  Title  II-A  in  the  sixteen  study  sites  over  a  22-month  period  from  1987  to  1989. 
Two-thirds  of  the  sample  were  randomly  assigned  to  go  into  the  program  and  one-third  were 
assigned  to  the  control  group.  We  collected  data  on  educational  attainment,  employment,  and 
earnings  fix)m  both  groups  through  a  followup  survey.  The  results  currently  available  follow 
the  sample  for  18  months  after  random  assignment. 

The  Main  Findings 

We  performed  sqjarate  analyses  for  adult  men,  adult  women,  male  out-of-school  youths 
(age  16-21)  and  female  out-of-school  youths.  (We  did  not  study  in-school  youths.)  Within  each 
of  these  groups,  we  examined  the  experience  of  three  different  "service  strategy"  subgroups: 
those  recommended  for  classroom  training;  those  recommended  for  on-the-job  training;  and 
those  leconunended  for  less  intensive  services,  such  as  job  search  assistance,  basic  education, 
and  job-readiness  training. 

For  adults,  the  major  findings  were: 

For  both  adult  men  and  adult  women,  JTPA  approximately  doubled  the  rate  of 
attainment  of  a  high  school  credential  (either  a  high  school  diploma  or  a  GED) 
during  the  followup  period; 

The  on-the-job  training  service  strategy  significantly  raised  the  earnings  of  both 
men  and  women.  We  estimate  that  the  program  increased  the  earnings  of  adult 
JTPA  enrollees  in  this  subgroup  by  about  $9(X)  per  year,^ 

The  classroom  training  service  strategy  significantly  increased  the  earnings  of 
adult  women  in  the  post-program  period,  but  had  no  statistically  significant  effect 
on  the  earnings  of  adult  men.  The  adult  women  in  this  subgroup  who  enrolled 
in  JTPA  experienced  annual  earnings  gains  of  about  $900  in  the  last  six  months 
of  the  followup  period;  and. 
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Among  those  randomly  assigned  to  the  program,  64  percent  oirolled  in  JTPA.  The  estimates  presented  here 


are  our  best  estimate  of  the  impact  of  the  program  on  these  enrollees. 
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Neither  the  women  nor  the  men  recommended  for  less  intensive  services 
experienced  statistically  significant  earnings  gains  over  the  followup  period. 

For  out-of-school  youths,  the  principal  results  were: 

The  program  increased  the  proportion  of  male  youths  who  attained  a  high  school 
credential  from  14  percent  of  all  dropouts  to  24  percent.  Similarly,  it  raised  the 
percentage  of  female  youths  achieving  a  high  school  credential  from  17  percent 
of  all  female  dropouts  to  29  percent; 

However,  the  program  had  no  statistically  significant  positive  effects  on  the 
earnings  of  female  youths  in  any  of  the  three  service  strategy  subgroups  or  male 
youths  in  the  classroom  training  subgroup; 

airollment  in  JTPA  actually  reduced  the  earnings  of  male  youths  recommended 
for  on-the-job  training  and  less  intensive  services  by  $1 ,200  to  $1 ,500  per  year. 
Further  analysis  revealed  that  these  earnings  losses  were  almost  entirely 
concentrated  among  male  youths  who  rqrarted  that  they  had  been  arrested  at 
some  time  before  applying  to  the  program.  This  subgroup  constituted  25  percent 
of  the  male  youths,  and  only  about  2  percent  of  the  overall  sample. 

Overall,  then,  the  program  appears  to  have  had  positive  effects  on  educational  attainment 
for  all  demogr^hic  subgroups;  modest  positive  impacts  on  the  earnings  of  adults,  especially  in 
the  on-the-job  training  subgroup;  and  no  effect  on  the  earnings  of  youths,  excq}t  for  male  youths 
who  had  been  arrested,  whose  earnings  were  r^uced  as  a  result  of  participating  in  the  program. 

In  viewing  these  results,  it  is  important  to  bear  in  mind  several  things.  First,  the  sixteen 
study  sites  are  not  necessarily  rq)resentative  of  the  nation,  although  they  do  reflect  the  diversity 
of  programs  found  across  the  country.  Second,  the  program  experience  on  which  the  study  is 
based  occurred  in  1987-89;  a  number  of  changes  have  taken  place  in  the  program  since  that 
time,  most  notably  the  1992  amendments.  Third,  our  results  are  restricted  to  the  JTPA  title 
serving  disadvantaged  workers  and  our  sample  did  not  include  in-school  youths.  Fourth,  these 
findings  cover  only  the  first  18  months  after  program  entry;  some  of  these  results  could  change 
with  longer  followup.  Finally,  it  will  be  important  to  consider  these  program  impacts  in  relation 
to  the  costs  of  the  program.  In  our  final  rqmrt  to  be  released  later  this  year,  we  will  extend  the 
analysis  to  30  months  and  will  present  a  comprehensive  analysis  of  program  costs  and  benefits. 
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Implicatioiis  and  Recommendations 

The  National  JTPA  Study  was  designed  to  measure  the  effects  of  JTPA  as  it  normally 
operates,  in  order  to  identify  those  parts  of  the  program  that  are  performing  well  and  those  that 
are  not.  We  believe  that  the  study  was  successful  in  doing  this. 

The  study  was  not  designed  to  tell  us  how  to  improve  the  program.  To  do  that  would 
have  required  testing  osw  service  i^roaches.  That  would  have  changed  the  way  the  program 
operated  and,  therefore,  run  counter  to  the  objective  of  evaluating  the  program  as  it  normally 
(grates. 

Thus,  I  cannot  tell  you  how  to  make  the  program  work  better  for  out-of-school  youths 
or  for  adults  curroitly  receiving  less  intensive  services.  What  I  can  tell  you  is  that  these  are  the 
areas  on  which  efforts  to  improve  the  program  should  focus. 

In  order  to  decide  what  should  be  done  in  these  areas,  I  strongly  recommend  further 
research  along  the  following  lines.  First,  I  recommend  that  the  Dqnrtment  of  Labor  look  very 
closely  at  the  way  the  JTPA  serves  male  youths  with  an  arrest  record,  in  an  attempt  to  discover 
why  the  program  is  having  an  adverse  effect  on  this  subgroiq). 

Second,  I  recommend  that  alternative  m^hods  of  serving  adults  currently  receiving  non- 
intensive  services  and  all  youths  be  developed  and  rigorously  evaluated.  I  cannot 
overemphasize  the  importance  of  rigorous  evaluation  of  new  approaches  to  serving  these  groups. 
Expeneace  has  demonstrated  that  simply  trying  out  alternative  program  strategies  without 
rigorous  evaluation  is  not  enough.  Nearly  ten  years  ago,  a  National  Academy  of  Sciences 
committee  reviewed  some  400  reports  on  a  wide  range  of  youth  employment  and  training 
demonstrations  and  concluded,  "Deq»ite  the  magnitude  of  the  resources  ostensibly  devoted  to 
the  objectives  of  research  and  evaluation,  there  is  little  reliable  information  on  the  effectiveness 
of  the  programs  in  solving  youth  employment  problems."^ 

Finally,  in  order  to  continuously  monitor  the  effectiveness  of  the  program  and  to 
determine  wh^her  any  of  the  changes  in  the  program  since  the  period  we  studied  have 
substantially  changed  the  effects  of  the  program,  it  is  important  to  periodically  evaluate  the 


'  Bctoey,  Ch«rie8L.,Robiii»onG.  HoUister,  indMrniy  R.  Pv^eorgiou.  1985.  Youth  Employment  and 
Training  Programs:  The  YEDPA  Years.  CommittM  on  Youtli  Enq)loyment  Programs,  Commissicm  on  Bduvioral 
and  Social  Sciences  and  Education,  National  Research  Council.    Wadiington,  D.C.:  National  Academy  Press. 
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existing  program,  using  methods  similar  to  those  used  in  the  National  JTPA  Study.  In  this 
connection,  I  should  note  that  the  Dqxartment  of  Labor  has  already  issued  a  request  for 
proposals  for  a  follow-on  study.  I  would  hope  that  this  study  could,  in  some  measure,  address 
all  of  the  issues  I  have  mentioned  here. 

I  realize  that  the  Congress  often  does  not  have  the  luxury  of  waiting  several  years  for 
more  research  to  be  conducted,  but  must  act  now  on  the  best  evidence  available.  At  the  same 
time,  I  think  it  is  important  to  invest  in  getting  better  evidence  so  that  when  these  same  issues 
arise  five  or  ten  years  from  now,  we  are  in  a  better  position  to  address  them. 

I  want  to  thank  you  again  for  this  opportunity  to  tell  you  about  the  National  JTPA  Study. 
I  have  brought  copies  of  a  more  detailed  summary  of  the  study  for  anyone  who  would  like  one, 
and  I  will  be  glad  to  respond  to  any  questions. 
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Executive  Summary 


THE  National  JTPA  Study  was  coiDmissioDed  by  the  Employment  and  Training 
Administration  of  the  U.S.  Departmeat  of  Labor  (DOL)  in  1986  to  measure  the 
impacts  and  costs  of  selected  employment  and  training  progranos  funded  under  Title  Il-A 
of  the  Job  Training  Parmership  Aa  of  1982,  which  b  targeted  to  serve  economically 
disadvanuged  Americans.  Thisrepoft  presents  interim  estimates  of  program  impacts 
on  the  eam'mgs  and  employment  of  adults  and  out-of-school  youths  in  16  local  service 
delivery  areas  during  die  first  18  months  after  their  accq>tance  into  the  program. 

Estimates  of  longer  term  program  impacts  on  earnings,  employment,  and  welfare 
benefits,  and  an  analysis  of  program  costs  and  benefits,  will  appear  in  the  final  rqx>rt  of 
the  study  (forthcoming,  from  Abt  Associates  Inc.).  A  companion  report  on  the  study's 
implementation  G^oolittle,  forthcoming)  describes  the  JTPA  programs  operated  in  the 
study  sites  and  the  types  of  JTPA-fiinded  services  provided  to  members  of  the  study 
sample. 


The  National  JTPA  Study 

This  study  grew  out  of  the  reoonunendatjons  of  the  Job  Training  Longitudinal  Survey 
Advisory  Panel,  a  group  of  nationally  recognixed  experts  in  employment  and  training 
research  formed  to  advise  DOL  on  the  evaluation  of  JTPA  (Stromsdorfer  et  al.,  198S). 
After  reviewing  evaluations  of  Cooprehensivc  Employment  and  Training  Act  (CETA) 
programs,  the  panel  concluded  that  the  only  reliable  way  to  measure  the  impacts  of 
employment  and  training  programs  was  to  condua  a  classical  experiment,  in  which 
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program  applicants  are  randomly  assigned  either  to  a  treatment  group ,  which  is  allowed 
access  to  the  program,  or  to  a  control  group,  which  is  not  Random  assignment  assures 
that  the  two  groups  do  not  differ  systematically  in  any  way  except  access  to  the  program. 
Thus,  subject  only  to  the  uncertainty  associated  with  sampling  error,  any  subsequent 
differences  in  outcomes  between  the  two  groups  can  confidendy  be  attributed  to  the 
program.  These  differences  are  termed  ;7rogram  impacts. 

Although  random  assignment  designs  have  been  used  to  evaluate  a  number  of 
demonstration  projects  and  state  programs,  the  Employment  and  Tuning  Administration 
was  the  first  federal  agency  to  apply  diis  approach  to  an  ongoing  national  program. 
Because  of  its  rigorous  design,  die  National  JTPA  Study  provides  the  first  reliable 
estimates  of  the  impacts  of  the  largest  employment  and  training  program  sponsored  by 
die  federal  government 

In  the  National  JTPA  Study  20,601  JTPA  applicants  in  16  service  delivery  areas 
(SDAs)  across  die  country  were  randomly  assigned  to  the  treatment  group  or  the  control 
group  over  the  period  November  1987  tfirough  September  1989.  The  earnings  and 
employment  outcomes  of  both  groups  were  then  measured  through  follow-up  surveys  and 
administrative  records  obtained  from  state  unemployment  insurance  agencies.  Data  on 
the  baseline  charaaeristics  of  the  two  groups  were  collected  as  part  of  the  program  in 
process,  and  information  about  the  employment  and  training  services  received  was 
obtained  from  follow-up  surveys  and  SDA  records. 

The  study  sites  were  not  chosen  to  be  representative  of  the  nation  in  a  statistical  sense, 
but  they  do  reflect  the  diversity  of  local  programs  and  local  environments  in  JTPA.  In 
particular,  the  performance  of  the  sites  during  die  study  period,  as  measured  by  JTPA 
performance  indicators,  was  not  noticeably  different  from  diat  of  all  SDAs  nationally.' 


The  18-Month  Impact  Analysis 

This  repoft  provida  estimates  of  the  impact  of  JTPA  Tide  II-A  on  the  earnings  and 
employment  of  four  target  groifpf— adult  women  and  men  (ages  22  and  older)  and  female 
and  male  outof-scfaool  youths  (aga  16  to  21>— over  the  first  18  months  after  random 
assignment.  Aduh  women  make  up  30  percent  of  die  national  JTPA  population;  adult 
men,  2S  percent;  and  out-of-scbool  youdis,  23  percent  In-school  youths,  who  are  not 
included  in  this  study,  form  the  remaining  22  percent. 


1.  Sec  AppoiduBMdCkificrS  for  eoopwiaauorilw  16  ttudysiei  with  aO  SDAs  Mlioaally. 
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The  analysis  is  based  on  a  subsample  of  17,026  sample  members  v^iose  First  Follow- 
up  Survey  interview  was  scheduled  at  least  1 8  noonths  after  random  assignment.'  For  eadi 
target  group  we  estimated  impacts  for  a  number  of  different  subgroups,  defined  by  the  types 
of  program  services  recommended  for  them  and  by  didr  baseline  diaracteristics. 

Because  the  study  was  designed  to  measure  the  effects  of  JTPA  as  it  normally  operates, 
the  analysis  investigates  which  JTPA-fiinded  services  were  working  well  for  those 
recommended  to  receive  diem;  the  analysis  does  not  assess  possible  aJtematives  to  the 
existing  program.  By  identifying  those  groups  for  whom  Title  II-A  is  having  positive 
effects  and  those  for  whom  h  is  having  no  effect— or  even  a  negative  effect— we  hope^tc^ 
help  policymakers  in  their  efforts  to  identify  those  parts  of  the  program  that  need 
improvement.  This  analysis  cannot,  however,  tell  policymakers  how  to  improve  the 
program,  since  it  does  not  compare  alternative  programs  for  similar  people.  Rather,  it 
measures  only  the  effects  of  die  existing  program  on  the  people  it  actually  served  over  the 
study  period. 

In  the  remainder  of  this  Executive  Summary  we  first  provide  an  overview  of  the 
estimated  effects  of  deprogram  on  the  earnings  and  employment  of  the  four  main  target 
groups— adult  women  and  men,  and  female  and  male  youths.  We  then  present  more 
deuiled  findings  for  adult  and  youth  subgroups,  in  turn,  and  conclude  with  implications 
of  the  fmdings  for  the  JTPA  program  and  future  research. 


Overall  Impacts  on  Earnings  and  Employment,  by  Target  Group 

JTPA  Title  n-A  had  generafly  positive  effects  on  the  earnings  and  enq)loyment  of  adults 
in  the  study  sites.  As  shown  in  the  top  pand  of  Exhibit  S.l,  access  to  the  program  increased 
the  average  18-month  earnings  of  the  adult  women  randomly  assigned  to  the  treatment 
group  CJTPA  assignees*)  by  an  estimated  $539,  or  7.2  percent  of  the  control  group  mean. 
Access  to  die  program  also  increased  the  percenuge  of  women  employed  at  some  time 
during  the  follow-up  period  by  2.1  percenuge  points.  Because  these  estimates  are 
statistically  significant  (as  indicated  by  the  asterisks  beside  them),  we  take  them  to  be 
reliable  evidence  of  positive  impacts  on  earnings.  In  this  analysis  we  accept  only  statisti- 
cally significam  estimates  as  evidence  of  real  program  effects. 

The  f^itnti^  program  impacts  for  aduh  mexi— an  earnings  gain  of  $550,  or  4.5 
percent,  and  an  increase  b  the  pcrccotage  employed  of  2.8  percentage  points— were 
similar  In  size  to  those  for  adult  women,  but  the  eaimatnd  impaa  od  earnings  was  not 
u  ftatisticany  ilgnMcaoL 


2.  Within  thia  It-moBlh  Miady  nmple.  Tim  Fello«Hiip  Sorvcy  dau  we  avuhbie  for  14.442  tanple 
orM-tpoccatordMi 
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Exhibit  S.1       Impacts  on  Total  IMionth  Earnings  and  Employment:  JTPA  Assignees 
and  EnroUees.  by  Target  Group 


Adults 

Out-of-sdiool 

youths 

Impact  on: 

Women 
0) 

Men 

a) 

FemaU 
(3) 

Male 
(4) 

Eanuii(s 
Id$ 
A(a% 

Percenuge  employed  * 

Sample  site  (assignees 

and  control  group) 

$    539"* 

7.2% 
2.1" 

6.474 

Per 

$    550 
4.5% 
2.8** 

4.419 

assignee 

$  -182,    ^ 
•2.9% 
2.8 

2.300 

$    -854»« 

-7.9% 
1.5 

1.748 

Earningi 

Asa% 
Percenuge  employe/ 

$    873* 
12.2%^ 

Per  enroUee 

$935*                   $  -294* 

6.8%  ^                    -4.6%^ 

4.8                            4.5* 

$  -1.356* 
-11.6% 
2.4* 

a.  Aluqr  I 

*   Tmu  of  ■awiifl'tn«ifie«M»  »«iw  — 1»  ifwd  far  ifcli  per  i 
•  SMMbedjr  agiirBM  «  *c  .10  li««l.  ••  at  *•  Xk}  !>•<•»  al  *•  i)l  ln«l  (l»e4Mled  lot). 


In  contrast  to  the  findings  for  adults,  the  program  had  little  or  no  effect  on  the  average 
earnings  of  female  youths  (a  statistically  insignificant  earnings  loss  of  $-182,  or  -2.9 
percent),  and  the  program  actually  reduced  the  earnings  of  male  youths,  on  average— as 
evidenced  by  a  large,  statistically  significant  loss  of  $-854,  or  -7.9  percent,  over  the  18- 
month  period .  Access  to  JTPA  had  no  significant  effect  on  the  1 8-month  employment  rates 
of  either  female  or  male  youths. 

Hence,  the  findings  for  the  female  youths  are  clear-cut:  JTPA  had  virtually  no  effect 
on  their  earnings  or  employment.  Butthefindings  for  maleyouths  are  less  clear.  As  shown 
later  in  this  sununary.  almost  all  of  the  negative  average  impaa  on  the  earnings  of  male 
youths  is  concentrated  among  those  who  rqwrted  havmg  been  arrested  between  age  16  and 
random  assignmem  (25  percent  of  the  male  youth  treatmem  group).*  Thus,  the  estimated 
impact  for  most  male  youths  (the  75  percent  widi  no  previous  arrest)  was  negligible. 

The  estimates  discussed  above  are  average  impacts  on  the  earnings  and  employment 
of  all  sample  members  assigned  to  the  treatment  group.  Although  all  of  these  assignees 


3.  FiBtbenaare.  u  ooled  later  ia  dus 
wlinMUBd  tat  male  youtha  with  a  prrnoua  anoL 


;  there  is  aome  question  about  the  laige,  negative  impact 


y*  i 
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were  given  accus  to  JTPA;  not:iiU.Qf  tfinmiSiuIly  enrolled  in  the progranL  The  bottom 
panel  of  Exhibit  S.  1  presents  our  best  estimates  of  program  in^>acts  on  die  earnings  and 
employment  of  JTPA  enrollees  (assignees  who  were  later  enrolled).* 

Fstimated  impacts  per  enrollee— both  gains  and  losses— were  about  60  percent  to  70 
percent  larger  than  impacts  per  assignee,  dq>ending  on  the  target  group.  The  estimated 
earnings  gains  of  adult  women  and  men  who  were  enrolled  in  JTPA  were  $873  and  $935, 
respectively.  In^acts  on  youdas  were  eaminp  lo»es  of  $-294  for  females  and  $-1 ,356  for 
males.'  The  impaa  of  the  program  on  the  percentage  of  enrollees  m  each  target  group  who 
were  employed  ranged  from  an  increase  of  2.4  percentage  points  for  male  youths  to  ^ 
increase  of  4.8  percentage  points  for  adult  men. 

It  is  important  to  understand  that  the  impact  per  assignee  and  the  impact  per  enrollee 
are  not  two  different  estimates  of  the  overall  effect  of  the  program.  They  simply  spread 
the  total  estimated  program  effect  on  tbe  sample  over  a  larger  group  (assignees)  or  a  smaller 
group  (enrollees).  Thus,  the  two  sets  of  estimates  are  entirely  consistent;  they  just  measure 
different  concepts.  In  the  remainder  of  this  Executive  Summary,  we  focus  on  the  estimated 
inqMCts  per  nsignee,  because  they  are  die  most  reliable,  direct  experimental  evidence  of 
tbe  effects  of  the  program. 

Impacts  on  earnings  reflect  program  effects  on  both  the  amount  of  time  treatment  group 
members  worked  and  how  much  they  were  paid  per  hour  worked.  Exhibit  S.2  shows 
estimated  impacts  on  the  average  number  of  hours  worked  by  assignees  and  average 
earnings  per  hour  worked  over  the  follow-up  period,  expressed  as  percentages  of  the 
corresponding  control  group  means.  Tbe  percentage  impacts  on  these  two  components  of 
earnings  approximately  sum  to  the  percenuge  impact  on  total  earnings  per  assignee.* 


4.  To  deriwe  miiMtrt  fa  antket,  it  wm  aaotaary  lo  igume  thit  Ihae  wm  no  impact  on  the  earnings 
and  anployment  of  DooenroUeet.  Then  u  evideDoe.  bowcvo.  that  about  half  of  all  nanenroUees  had  some 
contact  with  the  progmn  after  TawVMnannnmrnl  and  recb»Bd  some  iinallyminimal — program  services.  As 
a  rouh.  the  rUnnatrt  in  the  bottoaa  panel  probably  o »u  itan  aomowhat  the  true  impact  on  eprollees,  while  the 
wtimatrd  impacts  per  assigDoe  ondeniaic  the  trae  inpad  oa  enrollees.  Thtu,  the  true  impact  co  enrollees 
probably  lies  somewhere  bctwma  these  two  witmalfi  Tht  estimates  for  enrollees  also  adjust  for  the  Tact  that 
3  percent  of  the  coBtrol  group  became  GoroOed  a  n?A.  despite  the  experiment '  s  embargo  oo  their  participation. 

5.  As  was  trve  of  the  fttimatwl  impact  pa  aasigpee  fa  male  youths,  the  large,  negative  impact  per 
cnraUee  fa  male  youths  is  due  almoat  cBlfl«ly  ta  a  ««fy  large  estimated  impact  fa  those  male  youth  enrollees 
with  a  previous  aucst 

6.  Because  the  impada  ea  caraiafs  pa  koar  wortad  wa<  cstimaird  indirectly,  we  did  not  calculate 
{■     aignificance  levcb  fa  theae  i 


61 


XXXVm  •    JTPA  1»-M0NTH  IMPACTS  /  EXECimVE  SUMMARY 


EMhit  S.2      Percentage  Impacu  en  Toul  18-M«mth  Earnings  and  Ita  Camponenta: 
JTPA  Assignees  and  EnrtXiees.  by  Target  Croup 


Adidt  Adtdt  FemaU  Uede 
Percentage  women  mm  youths  youths 
impaaon:  0) W W W_ 
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TcM  ef  ikliMic*!  •«Bificjacc  woe  act  pcrfaraied  for  B^Kti  OD  eanio(i  per  hour  woAed. 
*  Swuticaay  iVaifiuA  tf  te  .10  kvd.  **  at  te  .OS  level,  ***  M  te  i>l  lEvd  (M»«ukd  MO. 

As  shown  in  Exhibit  S.2,  the  7.2  percent  increase  in  earnings  for  adult  women  reflects 
a  combination  of  a  3.7  percent  bcrease  in  hours  worked  and  a  3.4  percent  increase  in 
average  hourly  earnings  anoong  those  who  worked.  The  earnings  gain  for  adult  men,  on 
the  other  hand,  was  entirely  atuibutable  to  a  4.5  percent  rise  in  hours  worked,  with  no 
increase  in  hourly  earnings. 

Among  female  youths  a  -4.7  percent  reduction  in  hours  worked  more  than  offsf^  a 
1 .9  percent  increase  in  hourly  earnings  to  produce  the  negligible  impact  on  total  ean»  . 
that  we  saw  earlier.  Among  male  youths  the  -7.9  percent  loss  in  total  earnings  was 
primarily  attributable  to  a  decrease  in  hours  worked  (of  -6.8  percent). 

Overall,  then.  JT7A  appears  to  have  had  modest  positive  effects  on  the  earnings  and 
employment  of  adult  women  and  men.  But  the  program  appears  to  have  had  virtually  no 
effea  on  the  earnings  and  employment  of  female  youths  and  most  male  youths.  In  contrast, 
it  may  have  had  a  large,  negative  impact  on  the  earnings  of  those  male  youths  who  had 
been  arrested  before  Uiey  applied  to  JTPA. 

When  estimated  separately  by  site,  positive  but  generally  insignificant  earnings  effects 
were  obtained  in  most  sites  for  adult  women  and  adult  men,  negative  but  generally 
insignificant  earnings  effects  were  obuined  for  male  youths,  and  a  majority  of  sites  yielded 
negative  but  insignificant  earnings  effects  for  female  youths  (not  shown  here).  Thus,  the 
main  18-month  earnings  findings  by  target  group  were  found  to  be  widespread  across  the 
16  SDAs  in  the  study.  And  despite  wide  variation  in  the  magnitude  of  these  estimated 
effects,  the  sites  did  doc  differ  significantly  from  one  another  in  the  degree  to  which  JTPA 
affeaed  earnings  in  any  individual  target  group. 

In  an  anempt  to  explain  the  variation  in  impact  estimates  across  sites,  we  conducted 
a  limited  exploratory  analysis  oflocal  factors  tlm  might  influence  program  impacts.  Three 
types  of  factors  were  considered:  (1)  characteristics  of  the  JTPA  programs;  (2)  prevailing 
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labor  market  cooditions;  and  (3)  the  types  of  persons  acc^ted  into  the  programs.  But  no 
clear  patterns  emerged  from  the  analysis;  and  almost  all  of  the  findings  were  statistically 
insignificant,  vdiich  is  probably  due  to  the  small  samples  at  each  site  and  &e  limited  number 
of  sites  involved.  * '" 


Findings  for  Subgroups  of  Adult  Women  and  Men 

The  impacts  presented  in  the  previous  section  are  estimates  of  the  average  effects  of  the 
program  on  each  target  group  in  the  study  sample.  Because  JTPA  provides  a  number  of 
difTerent  employment  and  training  services  to  a  wide  range  of  program  applicants^  if  is 
important  to  analyze  how  program  impacts  varied  with  the  types  of  services  offered  and 
the  characteristics  of  the  applicants.  In  this  section  we  therefore  present  estimates  of 
program  impacts  on  the  earnings  of  adult  subgroups  deflned  by  the  services  that  program 
intake  staff  recommended  for  them  and  by  selected  personal  characteristics. 


Service  Strategies  Recommended 

For  purposes  of  this  analysis,  members  of  die  study  sample  were  classified  into  three 
service  strategy  subgroups  based  on  the  services  that  program  intake  staff  reconunended 
for  each  sample  member  prior  to  random  assignment.^  Applicants  recommended  for 
classroom  training  in  occupational  skills  were  placed  in  the  classroom  training  subgroup. 
Those  recommended  for  on-the-job  training  (OJT)  were  placed  in  the  OJT/JSA  subgroup 
(so  named  because  many  of  the  treatment  group  members  in  this  subgroup  were  enrolled 
in  job  search  assistance  wbOe  searching  for  either  an  on-the-job  training  position  or  an 
unsubsidized  job).  Because  JTPA  staff  sometimes  recommend  combinations  and  se- 
quences of  services,  applicants  placed  in  either  of  these  subgroups  may  also  have  been 
recommended  for  any  of  several  other  services,  including  job  search  assistance,  basic 
education,  work  experience,  or  miscellaneous  other  services.  Those  applicants  recom- 
mended for  one  or  more  of  these  services— but  neither  dauroom  training  in  occupational 
skills  nor  on-the-job  training— were  placed  in  the  third  subgroup:  other  services.* 


7.  Service  Urategy  «ubgroup«  <werc  defined  bMed  oa  Ihc  aernca  nrtimmcntM  rtthcf'thMi  the  lervicq 
received  for  two  reunu.  Fim.  M  «•«  oot  poeiibte  lo  ideati/y  oooUol  sroup  memben  wiio  were  comparable 
to  the  beatmeDt  (roup  memben  wbo  received  particular  JTPA  aervicea,  wfaersas  it  moj  possible  to  identiry 
ccntiot  group  member*  wfao  «CR  racooaniended  Cor  the  aaae  aerricea  as  treatment  group  mernben.  Second, 
ad  more  AmdamcntaUy,  since  piugiam  atoff  caa  racwniiDciid  aervicea  bat  cannot  ensiac  that  applicants 
participate  in  thoae  aervices.  rwraiaiti  mini  aervicea  rtfttaeat  the  operative  piugiaui  dedaiop  to  be  evaluated. 

t.  A  tew  applicants  designated  for  thia  other  aervice  subgroup  oere  rcoominavfc<1  tor  classroom  training 
ca  occupational  skiUs  or  on-th»job  training  as  part  of '>Buataaiaed  training." 
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Exhibit  SJ     Service  Strategies  Kecommended: 
Adult  JTPA  Assignees,  by  Gender 


AduU 

AduU 

wcmen 

men 

Service  strategy 
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CUnroom  tnimng 

44Xi% 

24.6% 

OJT/ISA 

3S.0 

48.7 

Other  servicea 

IIJH 

26.7   ^ 

Sample  size 

4.465 

3.759 

As  shown  in  Exhibit  S.3,  neaiiy  half  of  all  adult  men  in  the  treatment  group  were 
reconmiended  for  the  OJT/JS  A  service  strategy,  with  the  remainder  about  equally  divided 
between  the  classroom  training  and  other  services  strategies.  Women  were  more  likely 
than  men  to  be  recommended  for  classroom  training  (44  percent  versus  25  percent)  and 
less  likely  to  be  reconunended  for  OJT/JSA  (35  percent  versus  49  percent). 

It  is  important  to  note  that  program  intake  staff  reconunended  services  based  on  i 
individual  applicants'  employment  needs  and  qualifications,  as  well  as  their  personal 
preferences.  The  service  strategy  subgroups  therefore  differed  from  one  another  not  only 
in  terms  of  the  service  recommendations  but  also  b  terms  of  personal  characteristics. 


ENROLLMEKf  RaTZS  AND  DURATION,  BY  SeRVKX  STRATEGY  SUBGROUP 

After  assessment  and  recommendation  of  services,  two-thirds  of  the  applicants  accepted 
by  intake  sufT  were  randomly  assigned  to  the  treatment  group,  which  was  allowed  access 
to  JTPA.  and  one-third  were  assigned  to  the  control  group,  which  was  excluded  from  JTPA 
for  18  months.* 

As  noted  above,  not  all  treatment  group  members  would  ultimately  become  enrolled 
in  JTPA.  Enrollment  rates  differed  by  lenrice  strategy  subgroup,  but  overall  they  were 
quite  similar  for  adult  women  and  men.  Within  the  treatment  group  as  a  whole,  65  percent 
of  adult  women  and  61  percent  of  adult  men  were  enrolled  in  JTPA  at  some  time  during 
the  18-month  follow-up  period.  Earollmeot  rates  were  highest  in  the  classroom  training 
subgroup  (73  percent  and  71  percent  for  adult  women  and  men,  respectively)  and  lowest 
in  the  OJT/JSA  subgroup  (55  percent  and  57  percent). 

9.  Thii  cmbwfo  on  «gv>co  to  ccmrol  group  membcr»  wm  mccggflilly  implrmrmwl  Over  the  course  of 
the  lt^nonlhfeDoi«»uppenod.caly  >pcrceatofcoBtrolpoupinen»her»bec«iieenn>UedinJT?A. 
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•-'  The  duration  of  enrollment  in  die  program  also  differed  by  service  strategy,  ranging 
from  a  median  lei^  of  about  2  mondis  for  women  and  men  in  die  OJT/ISA  and  other 
services  subgroups  to  median  lengths  of  enrollment  of  4  to  6  mondis  in  the  classroom 
training  subgroup.  Generally,  there  was  little  difference  by  gender  in  the  duration  of 
enrollment  except  that  women  in  classroom  training  tended  to  stay  in  die  program  about 
two  months  longer  than  men. 


Services  Received,  by  Service  Stratecy  Subgroup  <  ^ 

Within  the  classroom  training  subgroup  the  most  common  JTPA  services  received  by 
treatment  group  members  who  became  enrolled  in  the  program  were  classroom  training 
in  occupational  sk'ills,  basic  education,  and  job  search  assistance.  Enrollees  in  the 
OJT/JSA  subgroup  were  most  likely  to  receive  on-the-job  ^raining  or  job  search  assistance, 
or  both.  In  the  other  services  subgroup  the  most  common  services  adults  received  were 
job  search  assistance  and  miscellaneous  services,  such  as  job-readiness  training.  Exhibit 
S.4  shows  that  between  82  percent  and  89  percem  of  the  enrollees  in  each  service  strategy 
subgroup  received  one  or  both  of  the  two  key  services  characteristic  of  that  service 
strategy.  Thus,  the  three  service  strategy  defmltions  rqiresent  distinctly  different  mixes 
of  services  actually  received,  as  well  as  services  recommended. 

The  impacts  of  the  program  do  not  depend  solely,  however,  on  the  JTPA  services 
received  by  those  in  the  treatment  group.  Instead,  the  impacts  reflect  the  difference 
between  the  services  received  by  those  given  access  to  JTPA  and  the  services  they  would 
have  received  if  they  had  been  excluded  from  the  program.  That  is,  the  benchmark  against 
w^ich  we  measure  die  effects  of  JTPA  is  the  services  available  elsewhere  in  the 
community,  not  a  total  absence  of  services.  Our  measure  of  the  services  the  treatment 
group  would  have  received  if  they  had  been  excluded  from  the  program  is  those  received 
by  the  comrol  group,  who  wrere  excluded  from  the  program. 

Since  we  measure  impacts  per  auignee  (treatment  group  member),  the  relevant 
comparison  is  in  terms  of  services  per  assignee,  including  those  who  were  never  enrolled 
in  JTPA.  As  expected,  the  largest  treatment-control  group  difference  in  the  classroom 
training  subgroup  was  in  receipt  of  classroom  training  in  occupational  skills.  Among  adult 
women  49  percem  of  the  treatmem  group  received  this  service,  whereas  only  29  percent 
of  the  control  group  did.  Among  adult  men  these  figures  were  40  percem  versus  24 
percenL 

Adult  treatmem  group  members  in  the  OJT/JSA  subgroup  were  much  more  likely  than 
control  group  memben  to  receive  OD-<he-job  training.  We  estimate  that  29  percent  of  the 
%vomen  and  27  percent  of  the  men  in  the  treatmem  groiq)  m  this  subgroup  received  OJT, 


65 


XLD  •    JTPA  It-MOKTH  IMPACTS  /  EXECUTIVE  SUMMARY 


Exhibit  S.4       Key  JTPA  Services  Received  by  Treaxmem  Group 

Members  Who  Were  Enrolled  in  the  Program:  Adults,  by 
Gender  and  Service  Strategy  Subgrotqt 
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Job  seardi  assistance/ 
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Sample  size 


%  ofenrollees  receiving 
one  or  both  services 
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88.8%                         8S.S% 

OJT/JSA  subgroup 

On-the-job  training/ 

job  search  assistance 

87.8%                          86.5% 
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82.3% 
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88.7% 
2.286 


a.  'Batie  educaiioa*  jpcludu  Aduh  B«mc  Edi 
DevdopmcM  (GEO)  pwpf  ioo.  tad  Ea|liA  ■ 

k  'MucetUaeoM*  indudw  maammeOL,  job-feadii 
job  stadowing,  and  iryotf  ciiytoiuwt.  aaoaf 


(ABE),  high  Kbool  or  OeoenJ  EducMional 
•  Second  Laii|ua|B  (ESL). 

timiaiag.  cmiomirwl  miaing,  vocational  cxploratkm, 
oitacr  MTvioe*. 


whereas  less  than  1  percent  of  die  corresponding  control  groups  received  this  service,  since 
•  OJT  is  typically  not  funded  by  doo-JTPA  providers.  We  were  not  able  to  measure  control 
group  receipt  of  job  search  assisunce  f^m  non-JTPA  providers,  and  so  we  could  not 
estimate  the  treatment-control  group  difference  for  that  service. 

Ki  noted  earlier,  the  most  common  JTPA  services  provided  to  adults  in  the  other 
services  subgroup  were  Job  search  assistance  and  miscellaneous  services.  Around  25 
percent  of  adult  treatment  group  memben  in  this  subgroup  received  Ae  former  service,  and 
about  30  percent  received  the  latter.  We  were  unable  to  measure  receipt  of  these  services 
from  Don-JTPA  providen  and  therefore  cannot  estimate  the  treatment<onttol  groq> 
difference.  ^J        -^f  -  ■'''  ' 
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Among  adult  women  and  men  the  average  assignee  in  the  classroom  training  subgroup 
received^yjD  additigiul  ^10  llOfao 
ana  the  average  assignee  in  die  0JT/7S/ 
104  to  1 14  hoars  of  on-di6-Job  training. 


greceived;^y:iHi  additional  9^10  110 hoaratrfdassrooarttatolng  in  occupational  skOls, 
■    imt&t  average  assignee  in  die  0JT/7SA  subgroup  lUcewise  received  only  an  additional 


Impacts  on  Educational  ArrAiNMEKr,  by  Service  Strategy  Subgroup 

An  intermediate  effect  of  the  increment  m  services  received  by  treatment  group  members 
was  an  increase  in  educational  attainment  among  diose  who  were  high  sdiool  dropouU. 
Dropouts  made  up  around  30  percem  of  the  adult  target  groups.  Our  analysis  focuses  on 
the  attainment  of  a  rralning-relajed  high  school  credential,  Wf^ich  we  define  as  both  having 
received  a  sdiool  or  training  service  atid  having  received  a  high  sdioot  diploma  or  General 
Educational  Developmem  (GED)  certificate  at  some  time  during  die  ISnnontb  follow-up 
period. 

As  might  be  expected,  die  inaease  in  educational  attainment  was  greatest  among  those 
dropouts  recommended  for  the  dassroom  training  service  strategy.  Exhibit  S  J  indicates 
that  nearly  30  percent  of  the  adult  dropouts  in  the  dassroom  training  treatment  group 
received  a  training-rdated  high  school  credential,  whereas  only  11  percent  of  the  control 
group  did— for  impacts  that  were  highly  significant  in  the  cases  of  bodi  genders.  There 
were  smaller,  but  still  statistically  significant,  increases  in  the  proportions  of  female 
dropouts  in  the  other  services  subgroup  and  male  dropouts  in  the  OJT/JSA  subgroup  who 
attained  a  high  school  credential  as  a  resuh  of  the  program.  But  there  were  no  significant 
effects  on  educational  atu'inment  among  women  in  the  OJT/JSA  subgroup  or  men  in  the 
other  services  subgroup. 


Exhibit  S.  5        bnpacu  om  Atuimmtmt  tfa  Ttmiung-Ktlaitd  High  School  Diploma  or  CED 

Ctrtifical*:  Admit  JTTA  Attifmtts  Mike  Wtrt  High  Sdtool  Dropouu.  by  Ctmttr 
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Impacts  on  Earnings,  by  Service  Stuategy  Subgroup 

Exhibit  S.6  shows  the  estimated  program  impacts  on  the  earnings  of  adult  women  and  men 
in  each  service  strategy  subgroup.  As  shown  in  the  second  column  of  the  top  panel  of  the 
exhibit,  impacts  on  the  earnings  of  adult  women  in  the  classroom  training  subgroup 
followed  the  expected  panem  for  this  type  of  service:  an  earnings  loss  in  the  first  quarter, 
represent'mg  an  initial  investment  of  time  in  training,  followed  by  a  payback  period  of 
rising  earnings  gains  in  the  next  five  quarters,  with  statistically  significant  gains  of  $144 
and  $188  in  the  last  two  quanen  of  the  follow-up  period.  The  ovei^l  18-month  earnings 
gain  of  $398  for  women  in  this  subgroup  was  not  statistically  significant.  This  gain 
reflected  an  estimated  8.9  percent  program-induced  increase  in  the  hourly  earnings  of 
those  women  who  worked,  which  more  than  offset  an  insignificant  -2.S  percent  drop  in 
the  average  number  of  total  hours  worked  by  all  adult  women  over  the  follow-up  period 
(estimates  not  shown  in  the  exhibit). 

The  estimated  impacts  on  the  earnings  of  adult  men  in  the  classroom  training  subgroup 
are  less  clear.  None  of  the  impacts  on  quarterly  earnings  was  significantly  different  from 
zero,  nor  was  the  overall  impaa  on  total  earnings  over  the  follow-up  period..  Moreover, 
the  program  bad  do  significaat  impact  on  iht  employment  rate  or  hours  of  work  over  the 
follow-up  period  for  thu  subgroup  of  men  (estimates  not  shown).  Thus,  there  ii. 
evidence  of  a  program  impact  on  the  earnings  and  employment  of  this  subgroup. 

In  contrast  to  the  pattern  for  women  in  the  classroom  training  subgroup,  women  in  the 
OJT/JSA  subgroup  (middle  panel  of  the  exhibit)  experienced  an  immediate  and  sustained 
positive  impaa  on  average  earnings  throughout  die  follow-up  period,  as  might  be  expected 
with  a  strategy  that  emphasizes  immediate  placement  in  either  an  on-the-job  training 
position  or  a  regular  Job.  Women  in  the  OJT/JSA  subgroup  had  significant  quarterly 
earnings  impacts  of  $  109  to  $144  in  five  of  the  six  quarters,  with  a  significant  gain  of  $742 
over  die  follow-up  period  as  a  whole. 

Men  in  the  OJT/JSA  subgroup  experienced  estimated  gains  of  similar  magnitude  in 
five  of  the  six  quanen  and  over  the  follow-up  period  as  a  whole,  although  the  estimated 
impacts  were  less  often  sutistically  significant.  Over  the  18  months  men  in  this  subgroup 
experienced  significant  earnings  gains  of  $781. 

Both  women  and  men  in  the  OJT/ISA  subgroup  experienced  a  positive  and  significant 
impact  on  hours  worked;  and  mea,  on  their  employment  rate  (estimates  not  shown  in  the 
exhibit).  Indeed,  the  earnings  gains  of  both  women  and  men  In  tiiis  subgroup  were  due 
primarily  to  increases  in  the  number  of  hours  worked  per  sample  member,' radierdian  to 
higher  bouriy  earnings  while  employed,  -t-^ — 
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In  contrast  to  the  sustained,  positive  inq>act  on  earnings  in  the  OJT/JSA  subgroup,  the 
program  appears  to  have  bad  only  a  short-lived  effect  on  the  earnings  of  adult  women,  and 
virtually  no  effect  on  the  earnings  of  adult  men,  in  the  other  services  subgroup  (bottom 
panel).  JTPA  bad  a  significant  impact  on  women's  earnings  of  $220  in  the  diird  quarter, 
followed  by  much  smaller,  insignificant  gains  in  the  later  quarters.  The  estimated  in^>acts 
on  hours  worked  quarterly  (not  shown)  mirrored  this  pattern— possibly  reflecting  quicker 
placement  in  jobs  that  were  similar  to  those  die  female  assignees  would  have  eventually 
found  without  access  to  JTPA.  For  men  in  the  other  service  subgroup,  neither  the 
estimated  impacts  on  quarterly  earnings  nor  the  estimated  impacts  on  hours  of  work  (not 
shown)  were  statistically  significant.  % 

Overall,  then,  JTPA  led  to  modest,  statistically  significant  earnings  gains  in  at  least  one 
quarter  for  adult  women  in  all  three  service  strategies.  The  timing  of  impacts  was  very 
different  across  the  subgroups,  however,  and  significant  for  the  follow-up  period  as  a  whole 
only  in  the  OJT/JSA  subgroup.  Significant  impacts  on  the  earnings  of  adult  men  were 
concentrated  exclusively  in  the  OJTAISA  subgroup. 

It  is  important  to  iterate  that  the  adults  in  the  three  service  strategy  subgroups  differed 
not  only  in  the  services  they  received,  but  also  in  their  personal  charaaeristics.  Program 
intake  staff  tended  to  recommend  the  most  employable  applicants  for  die  OJT/JSA  service 
strat^y.  This  difference  is  evident  ix>t  only  in  the  data  on  baseline  charaaeristics  of  *'  " 
three  subgroups  (not  shown  here)  but  also  in  the  earnings  of  control  group  members  o  . 
the  follow-up  period,  shown  in  columns  (1)  and  (3)  of  Exhibit  S.6.  These  figures  indicate 
that  in  the  absence  of  program  services  women  recommended,  fot  On/JSA~woaldJuye 
earned  substantially  more  than  those  reoommeDded  for  classroom  training  and  somewhat 
more  than  those  recommended  fw  other  services.  Among  men  the  more"]6l^eady 
applicants  tended  to  be  recommended  for  either  QIT/JSA  or  other  services;  those  male 
control  group  memben  recommended  for  classroom  training  earned  somewhat  It^^over 
the  follow-up  period  than  dther  of  the  other  two  subgnwpt. 

Because  of  these  differences  in  the  three  subgroups,  one  cannot  extrapolate  the  impacts 
for  one  service  strategy  subgroup  to  the  women  or  men  served  by  another.  We  caimot, 
for  example,  conclude  that  the  program  outcomes  for  adult  men  in  the  classroom  training 
subgroup  «vould  have  been  better  if  instead  they  had  been  recommended  for  the  OJT/JSA 
service  strategy.  We  can  only  determine  wtich  service  strategies  were  ttftcxiyt  for  those 
appllcanu  recommended  for  them.  Whether  another  service  strata  would  have  been 
more  effective  cannot  be  determined  on  the  basis  of  tfiis  study,  since  we  did  not  observe 
alternative  service  approacfacs  applied  to  oonq>arable  participant  populations.    ..  >  ^^ 

It  b  also  important  to  bear  b  mind  that  tfie  costs,  as  wdl  as  the  impacts,  ofttettree 
service  strategies  were  likely  to  have  varied,  as  may  die  longer  term  In^acts.  USIbcIUI 
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>lMPAcn  ON  Earnincs,  BY  ETHNiaTY  AND  BAMUEits  TO  Employment 

Id  addition  to  the  diree  subgroups  defined  based  on  service  strategy  recommendations,  we 
estimated  program  impacts  on  the  18-month  earnings  of  a  number  of  other  subgroups  of 
women  and  men,  defined  in  terms  of  personal  characteristics  measured  upon  their  appli- 
cation to  the  program.  These  estimates  helped  us  determine  vtdiether  the  impacts  c^  (he 
program  were  concentrated  within  certain  groups  of  interest  to  policymakers  and  program 
planners  or  broadly  distributed  across  all  adult  women  or  men.  In  this  Executive  Summary 
we  present  the  results  for  two  such  key  subgroups:  the  major  ethnic  groups,  and  groups 
facing  different  barriers  to  employment.* 

Exhibit  S.7  presents  the  estimated  program  impacts  on  the  earnings  of  M^ite.  black. 
and  Hispanic  women  (column  3)  and  men  (column  6).  Among  women  the  estimated 
>  impacts jq>pear  to  have  differed  noticeably  by  ethnic  group,  with  white  women  showing 
'  significant  earnings  gains  of  S723  over  &6  ISHDOotfa  follow-up  period;  black  women,  an 
insignificant  earnings  gain  of  $457;  and  Hi^anic  women,  an  insignificant  loss  of  $-414. 
Moreover,  sqiarate  tests  of  the  statistical  significance  of  the  differences  among  these 
impact  estimates  (not  shown)  indicate  the  differences  were  statistically  significant  at  near- 
conventional  levels.  Iht  estimated  impacts  for  adult  men  also  differed  by  ethnic  group, 
but  neither  the  estimated  impacts  for  individual  ethnic  groups  nor  the  differences  in  impacts 
among  the  subgroups  were  statistically  significant  and  therefore  could  have  arisen  by 
chance. 

In  an  attempt  to  narrow  the  range  of  possible  explanations  for  the  differences  in 
estimated  impacts  for  women  in  different  ethnic  groups,  we  estimated  adjusted  impacts  that 
controlled  for  differences  in  the  distributions  of  these  subgroups  across  study  sites  and 
across  service  strategy  subgroups .  When  we  controPed  for  differences  in  the  distributions 
of  the  three  ethnic  groups  of  women  across  the  study  sites,  the  estimated  impacts  for  these 
groups  were  not  significantly  different  from  one  another.  This  fmding  suggests  that  the 
differences  in  estimated  impacts  among  women  in  different  ethnic  groups  are  in  part 
attributable  to  differences  in  the  distributions  of  these  groups  across  sites.  In  addition, 
given  the  extreme  concentration  of  Hispanic  women  in  a  few  sites  we  cannot  reliably 
distinguish  negative  effects  on  Hispanic  women  as  an  ethnic  group  from  negative  effects 
on  all  women  in  one  or  more  of  the  sites  in  -vhich  Hi^tanic  women  were  concentrated. 


10.  Other  key  nibgjoupt  exumaed  in  (be  report  iadude  thoae  deCoed  by  work  and  Uaining  hisUxies. 
public  «««i««-i««>  lustofies.  boutefaold  incooie  and  eampostioB,  public  bousing  lUbu,  and  age. 
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ExhMt  S.7         Impaco  an  itu  J8-Atetuh  Eanunga  t^f  Ut^cr  Ethme  Grmps:  AditbJTPA 
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To  determine  whether  the  effects  of  the  program  varied  widi  the  degree  of  labor  market 
dUadvanuge.  we  also  estimated  mipacts  on  earnings  for  subgroups  defined  by  three 
barriers  to  employment:  welfare  receipt,  limited  education,  and  limited  recent  woHi 
experience. "  The  first  three  pairs  of  rows  of  Exhibit  S.8  show  the  estimated  impacts  on 
earnings  for  women  and  men  facing  eadi  of  these  barriers  and  for  those  who  were  not. 

The  mean  1 8-month  earnings  of  control  group  members,  shown  in  columns  2  ano  ^  of 
the  exhibit,  illustrate  that  these  barriers  were  indeed  serious  obstacles  to  employment. 
Control  group  members  in  all  three  subgroups  facing  tfiese  barriers  earned  much  less  over 
the  follow-up  period  than  diose  who  were  not. 

Among  both  women  and  men  the  estimated  impacts  tended  to  be  larger  for  those  not 
facing  the  barriers  in  question,  although  among  women  the  differences  in  impacts  between 
those  facing  and  those  not  facing  a  particular  barrier  were  smaller  than  the  differences 
among  men.  Separate  tesu  for  the  significance  of  these  differences  between  each  ;7air  of 
estimates  indicated,  however,  that  any  differences  shown  here  may  have  arisen  by  chance. 

Because  some  persons  who  were  facing  one  of  these  barriers  to  employment  may  also 
have  been  facing  one  or  both  of  the  other  barriers,  these  subgroups  overlap  to  some 
degree.  To  achieve  a  clearer  distinction  among  the  subgroups  in  terms  of  die  overall 
difficulty  of  becoming  employed,  the  bottom  panel  of  ExhibitJ..8  cat^orizes  die  women 

■    "1     .    • 'Jit  /  ••  » '.L'<2.•^:^.i.'?Y•:*rv^:'^i*^:^i.^- 

'  "'"'*il.   Wtffan  netipt »  defined  m  raoehrii^ Aid toFami^  whhbepea&it^auldnaltXFi^^ 


.crMycthacMliiwd&wbetfitiiyoBnipliCTtiooloJIPA.  UmtttS tdmeatim\»dtSaedt»)m±. 
of  •  hi|k  Khoo)  dipkn*  er  OED  eertifka<  ttiirfiiirf  rtcenf  i«ar*  c^crtotM  is  defined  ■•  biw^ 
IbaiilSweeksiBlhejarpnertBapplJcKiaatDJIPA.  TbeaethRcmeua^cfliimientoenvloymaitare 
nnular  to  Ifaoae  Med  te  other  raocBt  abidks  cf  JI?A  pragnsBS  (tec  US.  Oesenl  Ao^^ 
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and  men  in  the  sample  by  die  number  of  these  barriers  they  were  facing.  Again,  the 
average  earnings  of  the  control  groups  indicate  that  this  categorization  is  strongly 
predictive  of  what  JTPA  assignees  would  have  earned  without  the  program:  control  group 
earnings  fall  steadily  as  the  number  of  barriers  rises. 

For  both  women  and  men  the  impacts  were  the  largest  in  the  subgroup  facing  none  of 
the  three  barriers.  For  neither  women  nor  men.  however,  were  the  differences  in  impacts 
among  subgroups  statistically  tignificaot;  thus,  these  differences  may  merely  reflect 
sampling  error." 

StAIMARY  AND  COMPARUON  WfTH  PUyiOtn  FiNDINCS 

Overall .  JTPA  Title  II-A  had  a  modest  positive  impact  on  the  earnings  of  adult  women  over 
the  follow-up  period:  on  average,  a  significant  gain  of  SS39  over  the  18  months  following 
their  application.  Hie  cstimtted  eamfaigs  gala  for  men  was  similar  ($550)  but  was  not 
statistically  tignificaaL   These  overall  averages  mask  substamial  variation  in  both  the 


12.  Among  the  aduh  tcniale  aubgraups.  far 
least  u  latfc  M  tbow  diowB  here  cvcB  if 


there  i*  ■  46  pcRcnt  chance  of  finding  dilTerences  at 
■o  trac  diflerenoes  ID  inqiacU  amoog  tk^  wbgnupi. 
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magnitude  and  time  patterns  of  program  impacts  among  subgroups  of  women  and  men, 
however. 

When  adult  women  are'ott^brized  by  ttie  service  strat^y  recommended  by  program 
intake  staff,  the  only  ones  to  experience  a  statistically  significant  earnings  impaa  over  the 
follow-up  period  as  a  whole  were  tiiose  in  the  OJT/JSA  subgroup,  widi  a  gain  of  $742. 
Women  in  this  subgroup  enjoyed  consistently  positive,  statistically  significant  earnings 
increases  of  $109  to  $144  in  five  of  the  six  follow-up  quarters.  Women  ^  the  classroom 
training  subgroup  experienced  an  earnings  loss  in  the  first  calendar  quarter  of  the  follow- 
up  period,  followed  by  growing  positive  impacts,  and  culminating  in  significant  impacts 
of  $144  and  $188  in  the  fifUi  and  sixth  quarters.  Program  impacts  on  the  earnings  of 
women  in  the  other  services  subgroup  were  significant  only  in  the  third  quarter,  when 
these  women  gained  $220,  on  average;  impacts  for  this  subgroup  were  negligible  in 
subsequent  quarters. 

Impacts  for  adult  men  were  simUar  in  magnitude  to  those  for  women,  although  they 
were  less  frequently  statistically  significanL  As  with  the  women,  only  those  in  the 
OJT/JSA  subgroup  enjoyed  sigruficam  earnings  gains  (of  $781)  over  the  follow-up  period 
as  a  whole.  Estimated  impacts  on  the  earnings  of  men  in  the  classroom  training  and  othe^ 
services  subgroups  were  never  statistically  significant,  either  for  the  follow-up  period  h. 
a  whole  or  for  individual  quarters. 

These  impact  estimates  are  similar  in  magnitude  to  those  found  in  die  few  previous 
evaluations  that  have  used  rigorous  experimental  designs.  For  example,  studies  of  state 
work-welfare  programs  for  women  in  the  early  1980s  found  significant  positive  impacts 
in  the  first  two  years  after  random  assignment  that  ranged  up  to  about  $250  per  quarter." 
Evaluations  of  demonstration  programs  for  displaced  workers  in  Texas  and  New  Jersey 
found  similar  impacts  on  the  earnings  of  men— that  is,  in  the  same  range  but  not  statistically 
significant— in  the  first  year  after  random  assignment." 

Comparisons  whh  the  results  of  earlier  studies  are  complicated,  however,  by  the  fact 
that  the  programs  involved  in  those  studies  provided  somewhat  different  services  from 
those  in  JTPA  and  served  primarfly  subpopulations  sudi  as  welfare  recipients  and 
(for  men)  displaced  workers  and  ex-addicts.  Moreover,  Ae programs  for  women  examined 
in  earlier  studies  were,  nnlike  JTPA,  mostly  mandatory,  and  yet  had  lower  rates 
of  participation  in  employmeai  and  training  services  than  tfiose  of  our  study  sample.'  " 
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^'  Bnally,  n^en  adult  women  in  die  National  JTPA  Study  sample  were  classified  by 
ethnic  gfoop,  differences  In  estimated  kapam  on  earnings  were  emerged,  with  ^ite 
women  e]q>eridic(ng  greater  gains  than  mhiority  women,  particularly  Hispanic  women. 
Furdier  tests  revealed,  however,  tiua  diese  difFereoces  in  in^>acts  may  well  have  been  due 
to  the  concentration  of  Hispanic  women  b  a  few  sites  that  experienced  impacts 
substantially  below  the  average  for  all  women.  There  were  no  significant  differences  in 
impacts  on  the  earnings  of  adult  men  by  ethnic  group.  Impwat  estimates  for  adults  who 
were  and  were  not  subject  to  various  barriea  to  enq>loyment  were  not  statistically 
significantly  differett  firom  each  odier.  But  tiie  pattern  of  estimates  for  these  subgroups 
suggested  that  JTPA  produced  larger  positive  impacts  for  adults  widi  fewer  labor-market 
barriers. 


Hndings  for  Sul)groups  of  Female  and  Male  Out-of-School  Youths 

Out-of-school  youths  in  the  study  sample  were  classified  into  the  same  three  service 
strategy  subgroups  as  those  used  to  classify  adults:  classroom  training.  OJT/JSA,  and 
other  services.  These  subgroups  were  based  on  the  JTPA  services  recommended  for 
sample  members  by  program  imake  staff  before  random  assignmem. 


Service  Strategies  Recommended 

The  service  strategies  recommended  for  youths  reflect  a  difference  in  emphasis  between 
JTPA  Title  Il-A  programs  for  youths  and  those  for  adults.  Programs  for  adults  emphasize 
employment,  as  evidenced  by  the  fact  that  program  performance  standards  for  adults  are 
based  largely  on  job  placement  rates.  In  contrast,  programs  for  youths  emphasize  a  broader 
range  of  outcomes,  with  performance  standards  for  youths  based  in  part  on  "positive 
terminations,*  which  include  not  only  job  placements  but  also  participation  in  foither 
training  and  attainment  of  specific  job  competencies. 

A  comparison  of  Exhibit  S.9  and  the  earlier  Exhibit  S.3  indicates  that  youdis  were  far 
less  likely  than  adults  to  be  recommended  for  the  OJT/JSA  strategy,  especially  if  we 
compare  female  youths  with  female  adults  and  male  youths  with  male  adults.  Of  the  three 
service  strategies  OJT/JSA  places  the  greatest  emphasis  on  inunediate  enlployment;  thus, 
this  difference  between  youths  and  aduitt  reflects  the  difference  between  JTPA  programs 
for  the  two  age  groups.  In  addition,  youths  were  much  more  apt  than  adults  to  be 
recommended  for  the  other  services  strategy,  which,  as  discussed  below,  also  differed 
between  the  two  age  groups  in  the  mix  of  progiam  services  received. 

Service  strategy  recommendations  also  differed  between  female  and  male  youths 
themselves.  Female  youths  were  more  likdy  than  male  youths  to  be  recommended  for 
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Exhibit  SS  Service  Straxegies  Recommended: 
Out-o/School  Youth  JTPA  Assigi 
by  Gender 
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classroom  training  (44  percent  versus  30  percent,  respectively)  and  less  likely  than  male 
youths  to  be  recommended  for  OJT/JSA  (23  percent  versus  33  percent).  The  genders  were 
about  equally  likely  to  be  recommended  for  other  services  (33  percent  versus  37  percent). 


Enrollmekt  Ratcs  and  Duration,  by  Service  Strategy  Subgroup 

Enrollment  rates  overall  were  comparable  to  those  for  adultt,  with  65  percent  of  the  female 
youth  treatment  group  and  67  percent  of  the  male  youth  treatment  group  becoming  enrolled 
in  JTPA  Title  D-A  at  some  time  during  the  18-month  follow-up  period.  Treatment  group 
enrollment  rates  were  highest  in  the  classroom  training  subgroup  (71  percent  for  females 
and  IS  percent  for  males).  The  lowest  enrollment  rates  were  in  the  OJT/JSA  subgroup 
(57  percent  for  females  and  58  percent  for  males).  Tlie  other  services  subgroup  fell 
between  these  two  extremes,  with  enrollment  rates  of  63  percent  for  female  and  68  percent 
for  male  youth  treatment  group  memben. 

Out-of-scfaool  youths  who  enroDed  ia  JTPA  stayed  io.ttieprDgriaa)  sli^tly  longer.^an 
Vieir  adult  obonterparisTwith  tteJniadlmW&lon'ofeEfi^^^ 
5lbuai?^feriw»'j.6  fcondjnBTiadlt  «ii«Tiiy  lil  3l^Wn5nar^^8'fbutBC!^u5 
l2STuc^Si§otaSdFSigik  Tbaa,  the  median  duration  of  enrollmeiit. was  also  sligntJy 
longer  for  female  than  for  male  yoaSm,  llie  service  strat^y  subgrmq)  whfa  tfie  shortest 
enrollmeflts  was  OJT/JSA,  with  a  median  of  about  2  mondu  fot  bqdi  females  and  males; 
the  classroom  training  subgroup  had  the  longest  enrollmeots,  at  5^  months  for  females 
and  4.6  months  for  males.  The  median  for  die  other  services  subgrmq).  was  about  3  months 
for  both  target  grDupt.:^^ 
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Ediibit  S.10^.  .  K^  JTFA  Serviees  Received  by  Tnatment  Groiq^  Mgmbtn 
.,r-^^-<j  Yd  itt'vit^^'V  ^^^^  EnnOed  in  Ae  Fngram:,OM<f-5AoUJouAt, 

- '    .  - ' .  t.   I 

..^  »-        r-..  .-. ».  -'    %  ^ennOeee  receiving 

€ne  or  bcdi  services 


Key  services 

in  service  strategy  subgroup 


Female 

youths 

0) 


Mate 
youths 

a) 


Oassroom  tradrmg  subgroup 


CUuroom  tnininj  in  oocupatkmtl 
•kill</b«sic  educatioo  * 


86.1* 


80.4% 


OJT/JSA  subgroup 


On-tb»-job  tndninf/ 
job  tauch  MsisUnoe 


84.8  S 


84.5« 


Basic  educatioii/ 
Sample  size 


OAer  services  subgroup 


79  J  « 
1.188 


83.2% 
959 


Services  Receiveo,  by  Service  Strategy  Subgroup 

Exhibit  S.IO  shows  the  percentage  of  enrollees  io  each  service  strategy  subgroup  who 
received  one  or  both  of  the  key  services  b  that  service  strategy.  About  86  percent  of  female 
youth  enrollees  and  about  80  percent  of  male  youth  enrollees  reoonunended  for  classroom 
training  received  classroom  training  b  occupational  skills,  basic  education,  or  both. 
About  85  percent  of  the  female  and  male  youth  enrollees  b  the  OJT/JSA  subgroup  received 
on-the-job  trainbg.  job  search  assistance,  or  both.  And  about  80  percent  of  the  female 
and  83  percent  of  the  male  youth  enrollees  b  the  other  services  subgroup  received  basic 
education,  miscellaneous  services,  or  both. 

The  only  obvious  difTercoce  between  the  mix  of  JTPA  services  received  by  youths  and 
the  mix  received  by  adults  was  b  ttM  other  services  subgroup.  Whereas  adult  enrollees 
b  this  subgroup  received  mainly  job  search  assistance  and  miscellaneous  services  (Exhibit 
S.4),  the  youth  enrollees  received  mainly  basic  education  and  miscellaneous  services- 
further  evidence,  as  noted  earlier,  that  JTPA  emphasbes  immediate  employment  for  adults 
more  tfian  It  does  for  youths. 
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As  with  the  adults  in  our  saiiq)]e,  tfie  estimated  program  Impacts  on  youdis  rqwrted 
below  reflea  differences  in  the  employment  and  training  services  received  by  treatment 
group  members,  who  had  access  to  JTPA,  and  die  services  they  would  have  recdved  if 
diey  had  been  excluded  from  the  program,  as  measured  by  data  on  control  group  members. 
And  as  with  adults,  the  size  of  these  treatment-control  group  diffierences  in  service  receipt 
varied  by  service  strategy  subgroup. 

•  In  the  classroom  training  subgroip  about  48  percem  of  the  female  youths  and  43 
percent  of  the  male  youdu  in  the  treatment  group  received  classroom  training  in 
occupational  skills,  whereas  only  31  percent  of  the  female  youths  and  22  percent  of  the 
male  youths  in  the  control  group  received  this  service.  In  Uie  OJT/JSA  subgrot^  about 
30  percent  of  the  females  and  31  percem  of  the  males  in  the  treatment  group  received  on- 
the-job  training,  while  less  than  1  percent  of  both  females  and  males  in  the  control  group 
received  the  service. 

We  were  unable  to  measure  the  control  group's  receipt  of  miscellaneous  services— the 
most  common  category  of  services  received  by  youth  treatmem  group  members  in  the  other 
services  subgroup,  at  29  percent  for  females  and  35  percent  for  males.  It  is  therefore  not 
possible  to  determine  the  treatment-control  group  difference  in  service  receipt  for  this  key 
service  in  the  subgroup.  The  service  difTerential  was  small,  however,  for  basic  education, 
the  other  key  service  received  by  youth  treatmem  group  members  who  were  recommend"* 
for  the  other  services  strategy.  About  23  percent  of  female  youths  and  14  percent  of  nv 
youths  in  the  treatment  group  received  basic  education,  while  19  percent  of  the  females 
and  12  percem  of  the  males  m  die  control  group  recdved  it 

Thus.  JTPA  produced  a  noticeable  increment  in  service  receipt  in  the  two  service 
strategy  subgroups  for  which  we  could  measure  the  differences:  dassroom  training  and 
OJT/JSA.  In  the  third,  other  services,  we  could  not  measure  die  treatmem-control  group 
difTerential  for  the  most  common  service  received  by  the  treatmem  group  and  found  only 
a  slight  differential  in  the  case  of  the  other  key  service.  In  terms  of  the  average  number 
of  hours  of  services  recdved,  JTPA  produced  a  modest  increase  for  the  two  subgroups  for 
which  we  could  measure  this  effect.  Female  and  male  youths  in  the  classroom  trdning 
subgroup  recdved.  respectivdy.  187  and  127  more  hours  of  classroom  training  in 
occupational  skills  than  they  would  have  if  JTPA  were  not  available,  while  female  and 
male  youths  in  the  OTT/JSA  subgroup  recdved,  respectivdy,  an  additional  lOS  and  128 
hours  of  on-the-job  training.  ■  .^. 

Impacts  on  Eoucatbnal  ArrAVoiEifr.  ir  SERvn  SntATeoY  S^y^otou^^jay^idi^jc^. 

Differeoces  In  the  services  recdved  by  youths  hi  die  treajmentand  qontrolg^Bi^prpduced 
difTereaces  in  the  rate  at  which  high  school  dropouts  in  diese groups^ atb|iinedj|hlg]bsdiool 
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diplonu  or  GED  certificate.  Si&ce  half  of  the  fdnale  youths  fai  die  study  sample  and  three- 
fifths  of  the  male  youths  were  high  sdKX)t  dropouts,  impacts  on  their  educational 
attainment  represent  an  in^rtant  resoh  of  the  program. 

As  shown  in  the  fburdi  row  of  Exhibit  S.ll,  among  control  group  members  who  were 
dropouts  17  percem  of  the  female  youths  and  14  potent  of  the  male  youtfis  both  eorolled 
in  a  school  or  training  service  and  received  a  high  school  diploma  or  GED  certificate  at 
some  time  during  the  IS-month  follow-up  period.  Among  Uie  corresponding  treatment 
group  members,  however,  29  percent  of  the  female  youths  and  24  percent  of  the  male 
youths  subsequently  attained  a  training-rdated  high  school  credential.  The  program 
impact  in  both  cases  was  highly  significant.  Impacts  were  also  statistically  significant  for 
male  youths  in  all  three  service  strategy  subgroups  and  for  females  in  the  classroom 
training  and  other  services  subgroups— the  two  service  strategy  subgroups  that  focused  the 
most  on  basic  education.  The  Impaa  was  particularly  striking  for  female  youths  m  the 
^  classroom  training  subgrotq). 


Impacts  on  EARNtNOS.  vc  Sekvicc  Stuatioy  Subcroijp 

As  noted  at  the  outset,  the  estimated  program  impaa  on  the  earnings  of  female  youths 
overall  was  negligible;  the  impact  oo  male  youths  overall  was  substantially  negative,  but 
that  impact  was  largely  concentrated  among  those  male  youths  who  reported  having  been 
arrested  between  their  sixteenth  birthday  and  random  assignment.  Exhibit  S.12  provides 
a  more  deuiled  understanding  of  these  findings  by  presenting  estimates  for  the  three  service 
strategy  subgroups  of  youths  during  each  of  the  six  quarters  of  the  follow-up  period. 
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b  «9tf  In  ihifhaiitii  dassroom  training  nbgroiq)  inq)acts  on  earnints  were  negative  and 
'ttiftisUcally  significant  daring  the  first  tliree  fbllow-ui^  qoarten.  ■  As  witti  adult  women, 
2  fiie£e'lnitial  losses  probably  reflect  flie  earnings  forgone  by  treatment  group  members 
^  while  Aey  were  attading  classes.  Unlike Ute  experience  ofadult  women,  however,  female 
■  youths  in  dassroom  training  did  not  eiperience  any  significant  increases  in  earnings  later 

in  the  follow-i^j^eriod.  Heac^  H^FSSSi^^BSBitr^tM^AitM  while  participattaig  in. 

dassrdoaTGrainmg  wavnofoffiefby  *  paylHi&  period,  at  least  not  by  die  end  of  the  1&^. 

month  follow-up. 

• 

Female  youths  in  the  OJTUSA  nibgroup  experienced  a  different  pattern.  The  initial 
impacts  on  their  earnings  were  moderatdy  positive  (and  statistically  significant  m  the 
second  follow-up  quarter),  which  may  reflect  an  initial  boost  in  employment  produced  by 
on-the-job  training,  job  seardi  assistance,  or  both.-  But  diese  short-run  gains  were  not 
pistaippd  over  time.  - 

Program  impacts  on  die  earnings  of  female  youths  in  the  taker  services  subgroup  were 
negligible  in  all  six  follow-up  quarters.  In  other  words,  the  mix  of  predominantly 
miscdlaneous  services  and  basic  education  that  JTPA  provided  to  this  subgroup  had  little 
or  no  impaa. 

The  impaa  estimates  for  male  youths  in  the  dassroom  training  subgroup  were  similar 
to  those  for  their  female  youdi  counterparts.  Impacts  were  substantially  negative  and 
statistically  significant  in  the  finx  follow-up  quarter,  again,  perhaps  reflecting  the  costs 
of  being  in  dass  instead  of  employed.  And  as  with  female  youths,  the  later  follow-up 
quarters  brought  no  earning  inaeases  large  enough  to  offiset  the  initial  loss. 

Impacts  on  male  youths  in  the  OJTUSA  subgroup  were  negative  in  all  s'u  follow-up 
quarters.  Over  die  follow-up  period  as  a  whole  the  OJT/ISA  stratqiy  yidded  a  statistically 
significant  earnings  loss  of  i-1313,  or-10.3  percett  of  the  oorreqwnding  control  group's 
mean  earnings.  This  loss  reflected  OAlnly  an  estimated  -8  J  percent  program-induced 
reduction  hi  die  average  unnber  of  hours  worked  by  male  youds;  average  hourly  earnings 
among  those  w^o  worked  were  largdy  unaffected  by  the  program  (not  shown  in  the  exhibit). 

Male  youths  in  the  other  services  subgroup  experienced  an  estimated  earnings  loss  of 
S-1 ,305,  or  -13.3  percent  of  what  their  earnings  would  have  been  without  access  to  JTPA. 
This  loss  reflected  mainly  a  -9.7  percem  reduction  in  die  average  number  of  hours  worked, 
dthough  average  hourly  earnings  when  working  were  also  reduced  by  an  estimated  -4.0 
percent  (not  shown)." 


IS.  TlKperoenUgeiiii{MctioalMi««wa(tad  and  cacMsiats  per  Iwurworiced  do  not  lum  exactly  to  the 
pmmtige  impact  oo  lotsl  raniintt  bmine  Ifae  fdatiandup  t>et<xea  toUl  *«*""'f  and  its  compooenu  is 
Buhipticativc  not  additive. 
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For  tbese  last  two  service  strategy  subgroups  of  male  youths,  it  therefore  appears  that 
the  negative  program  intact  on  earnings  reflected  mainly  a  negative  program  impact  on 
the  number  of  hours  worked,  as  opposed  to  a  n^ative  impaa  on  die  hourly  earnings  of 
those  who  worked.  The  next  subsection  wDl  also  demonstrate  that  the  negative  impacts 
on  earnings  for  the  OJT/ISA  and  the  other  services  subgroups  of  male  youths  are 
attributable  primarOy  to  a  large  negative  estimated  impact  on  the  earnings  of  those  male 
yoiiths  with  a  previous  arrest  who  were  recommended  for  each  of  tbese  two  service 
strat^ies." 

It  is  important  to  bear  in  mind  that  although  diis  analysis  by  service  strategy  subgroup 
is  illuminating,  one  cannot  interpret  the  findings  for  one  service  strategy  subgroup  as 
having  direct  implications  for  the  youths  recommended  for  one  of  the  other  two  service 
strategies.  Again,  we  can  only  determine  which  service  strategies  were  effective  for  those 
applicants  recommended  for  tfiem,  because  the  three  service  strategy  subgoups  differed  in 
the  personal  characteristics  of  their  members. 


Impacts  on  Earnings,  by  Ethnioty,  Barriers  to  Empijoyment,  and 
Reporteo  Arretts 

The  estimated  program  impacts  on  earnings  for  out-of-school  youths  did  not  vat/ 
systematically  with  the  ethnic  backgrounds  of  san^le  members  or  with  the  barriers  to 
employment  tfiey  faced  when  they  applied  to  JTPA. 

Exhibit  S.13  presents  the  estimated  program  iiiq>acts  on  \Mte,  black,  and  Hispanic 
youths.  The  impact  estimates  for  female  youdis  did  not  differ  substantially  by  ethnic 
group,  and  no  ethnic  group  experienced  a  statistically  significant  impact.  In  addition, 
separate  tests  of  the  statistical  signiflcance  of  die  diffinnces  among  die  impacts  on  diese 
groups  (not  shown)  confirm  the  lack  of  a  differential  effect  of  JTPA.  For  the  male  youths 
there  were  differences  in  estimated  impacts  among  the  three  ethnic  groups,  but  these 
differences  were  not  statistically  significant  and  may  therefore  have  been  due  to  chance 
(test  not  shown). 

Exhibit  S.I4  prtseos  the  estimates  for  subgroi^is  of  youdis  defined  in  terms  of  the 
three  sptdfk  banrien  to  employment  Investigated  for  adults:  Mie(/are  receipt,  Undted 
education,  9Bd  limited  recent  work  experience.  As  was  die  case  ft>r  adults,  theseWriers 
rq>reseflted  serious  obstacles  to  eoploymeot  for  youdu,  as  evidenced  ty  die  fikt  dutt 


'  IC  |loiclhi<tlttaKbsMlla«dMrttilkiIlyiiiflpii6cH<a«iniatediii9aetaolheamdoporia^ 
yrtii  ill  flu  I !■■■  WM  tiiMBt  ■rfumiy  li  ant  ■ttrilwmWr  In Itiii  witnn  iii]<^  hiriini  ■  nihiHiitiilly  nniUrr 
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control  group  earniogs  drop  markedly  as  the  number  of  barriers  increases  (bottom  panel 
of  the  exhibit). 

There  was  no  statistically  significant  relationship,  however,  between  the  number  or 
nature  of  these  employment  barriers  and  the  effect  of  JTPA  on  out-of-school  youths. 
Among  female  youths,  in  particular,  there  was  little  difference  between  the  estimated 
program  impact  on  sample  members  who  faced  eadt  of  die  diree  employment  barriers  and 
those  who  did  not  face  that  barrier.  Furthermore,  there  was  no  clear  pattern  in  the 
relationship  between  the  estimated  program  impacts  and  the  number  of  employment 
baniers  faced.  Tests  for  significant  differences  in  impacts  among  subgroups  (not  shown) 
revealed  none  that  was  statistically  significant. 

Among  male  youths  the  differences  between  the  impaa  on  sample  members  who  faced 
I  particular  employment  barrier  and  those  who  did  not  appear  to  have  been  more 
substantial.  For  male  youths  with  limited  education  or  limited  recent  work  experience, 
JTPA  appears  to  have  reduced  the  earnings  of  those  facing  one  of  these  two  barriers  by 
more  than  it  reduced  die  earnings  of  those  who  did  not  (top  panel,  column  6).  In  addition, 
the  more  barriers  hcti,  the  more  JT?A  seems  to  have  reduced  earnings  over  the  follow- 
up  period.  None  of  these  differences  in  impaa  estimates  between  or  among  the  subgroups 
were  statistically  significant,  however,  and  so  the  patterns  they  imply  are  only  suggestive 
and  nuy  in  fact  be  due  to  chance.  Moreover,  the  difference  m  impacts  was  in  the  opposite 
direaion  for  male  youths  receiving  wd^e  and  those  not  receiving  welfare. 

vxjk.^V^nt  the  most  mUngsubgroup  dlfforaiice  fef  youdis  was  between  the  Impacts 
tediiUtelffirlnale  youths  wbo  bad  been  arrested  before  and  those  who  bad  not.  Asshown 
in  Exhibit  S.IS,  on  avenge,  male  youths  with  a  previous  arrest  experienced  a  highly 
significant  $-3,038  program-induced  eaminp  loss  during  dieir  18-month  follow-up 
period.  In  contrast,  male  youths  without  a  previous  arrest  experienced  an  insignificant 
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$-224  earnings  lou.  The  difference  between  these  two  impaa  estimates  was  highly 
significant  and  did  not  diange  when  we  controlled  for  the  distributions  of  the  two 
subgroups  across  the  study  sites  and  service  strat^y  subgroups. 


Moreover,  this  difTereoce  appeared  in  all  six  follow-up  quarters,  all  three  service 
strategy  subgroups,  and  1 3  of  the  IS  study  sites  vt^ere  youths  were  included  in  the  sample. " 
The  negative  impact  on  the  subgroup  of  male  youths  with  a  previous  arrest  (25  percent  of 
the  male  youth  treatment  group)  accounts  for  82  percent  of  the  program-induced  earnings 
loss  fttf  male  youths  overall. 

It  is  important  to  mtt,  however,  that  these1arge,~negidivelmpactestimatcsj  which  are 


arrest  that  are  based  on  earnings 


data  from  an  alternative  data  source,  jnmwr.  the 
jfouO^  fira^  Ae  ,irta^,  jfnBif  •  ^"'^^  \fJS^..'^ %  the  youth 
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administrative  records  of  state  uneii^>loyinent  insurance  agencies. "  Impact  estimates  based 
on  UI  earnings  data  for  a  subsample  of  the  18-moDth  study  sample  suggest  there  was 
virtually  no  program  impaa  on  the  earnings  of  the  previous  arrestees  among  male  youths. 
Aitbou^  there  is  thus  some  question  about  die  d^ee  to  vMdk  JTPA  reduced  the  earnings 
of  those  mala  youdltt  with  «  devious  arrest,  both  data  sources  agree  that  the  program  did 
^Jncrtau  dielr  eambgs,  or  the  earnings  of  male  youths  overall. 

We  will  explore  further  the  differences  b  tfie  estimate  from  the  two  data  sources  in 
our  forthcoming  final  report.  The  impact  estimates  from  the  two  data  sources  do  not, 
however,  differ  appreciably  for  adult  women,  adult  men,  female  youths,  or  those  male 
youths  who  did  not  rq>ort  a  previous  arrest. 


Summary  and  Comparison  wtth  Previous  Findd^cs 

The  preceding  analysis  has  shown  that  JTPA  Title  D-A  did  not  appreciably  affect  the 
earnings  of  female  oui-of-school  youths.  On  average,  the  program  reduced  toul  earnings 
during  the  1 8-moDth  follow-up  period  by  $•  1 82  per  female  youth  assignee  (treatment  group 
member),  but  this  estimated  effea  was  not  statistically  significant.  Nor  were  the  impact 
estimates  statistically  significant  for  female  youths  in  each  of  the  three  service  strategy 
subgroups  or  in  any  of  the  subgroups  defined  by  personal  characteristics. 

The  findings  for  male  out-of-«chool  youths  are  very  different.  On  average,  JTPA 
reduced  the  estimated  earnings  of  this  target  group  by  a  statistically  significant  $-854  over 
the  18-iDonth  follow-up  period.     But  most  of  this  negative  estimated  impact  was 


It.  Appendix  E  mmmn  Ihis  innc.  Aa  diKaasad  iKcrc.  the  impact  findings  for  male  youths  with  a 
previous  ancst  diflier  betwMD  Ihe  n»o  dau  aourccs  because  canunp  dau  oo  the  treatment  group  and  the 
cootnl  group  of  male  yotik  arrcaiees  differ  between  the  vm  data  aourccs. 
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concentrated  among  the  25  percent  of  male  youths  who  had  a  previous  arrest.  Hence,  for 
most  male  youths  (the  7S  percent  «dio  reported  no  previous  arrest)  the  program  appeared 
to  have  a  negligible  effect,  as  was  the  case  for  female  youths. 

The  findrngs  for  out-of-school  youths  in  this  study  are  not  inconsistent  with  ±ose  from 
the  two  existing  experimental  studies  of  employment  and  training  programs  for  out-of- 
school  youths.'*  The  first,  the  youth  component  of  the  National  Supported  Work 
Demonstration,  evaluated  an  intensive  work  experience  program  (Manpower  Demonstra- 
tion Research  Corporation,  1980);  and  the  second,  JOBSTART,  evaluated  intensive 
education,  employment,  and  training  services  provided  throu^  JTPA'<(^ve  and  Doolittle, 
1991).  The  Supported  Work  study  found  negligible  post-program  impacts  on  the  earnings 
of  youth  participants,  most  of  whom  were  male.  JOBSTART  found  negligible  short-term 
impacts  for  female  youths  and  large  n^ative  short-term  impacts  for  male  youths, 
mirroring  the  findings  of  the  present  study. 

Both  JOBSTART  and  the  youth  component  of  Supported  Work  targeted  seriously 
disadvantaged  youths,  who  make  up  only  a  portion  of  the  out-of-school  youth  population 
targeted  by  JTPA  Title  D-A  programs.  And  Supported  Work  provided  far  more  intensive 
services  than  are  typically  available  from  JTPA.  Thus,  the  three  studies  of  employment 
and  training  programs  for  youths  focus  on  different  target  groups  and  program  services. 

Nevertheless,  none  of  these  studies  Indicates  Aat  die  programs  examined  weiiable 
to  improve  the  earnings  prospects  of  disadvantaged  youths;  and  two  of  9ie  tEfee  sbiflies 
found  that  the  programs  actually  reduced  the  earnings  of  male  youths;  atleis^ln&tSKhort 
term.  The  experimental  findings  to  date  are  ttierefore  cause  fbr  concern. 


Implications  of  the  Findings 

The  National  JTPA  Soidy  b  based  on  an  examination  of  16  study  sites,  which  are  not  a 
probability  sample  of  all  JTPA  service  delivery  areas  and  which,  despite  their  diversity, 
may  not  be  representative  of  the  nation.  Nevertheless,  to  the  extent  that  the  flndings  in 
this  report  apply  to  other  localities,  they  have  important  policy  implications. 

The  study  has  shown  that  JTPA  Title  D-A  is  helping  to  raise  the  earnings  of  many  of 
itt  participanu,  especially  adulu.  but  it  has  also  identified  several  groups  for  ixdioin  tiie 
program  b  having  no  effect  or  even  advene  effects.  In  particular,  die  lltleD'Apro^rain 


19.    AW»~^ iiMiyiirbii  iB^ihij— 1< ■Mlliiiiiimiiinmiiifrf/oiirtiilurr ^^^l itmlirjl inthrimt  Ihr 
fia£i^  obuuaed  pnmde  bak  idabk  iidarBMka  becauM  ofthe  inethoddogk^ 

roevdi  tfoi^f  (bH  were  mei.  See  (he  review  ia  Belaqr.  HoDisier.  and  riiipa|M>pow 
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Studied  failed  to  raise  die  average  earnings  of  out-of-sciiool  youdis  in  general,  and  they 
reduced  tiie  average  earnings  of  male  out-of-school  youttis  who  rq>orted  having  been 
arrested  between  tibeir  sixteenth  birthday  and  random  assignment 

But  aldiou^  ttiis  analysis  has  identified  groups  not  being  adequately  served  by  the 
program,  we  cannot  use  these  findings  to  prescribe  ways  to  serve  them  better.  The  study 
was  designed  to  observe  only  the  impacts  of  JTPA  as  it  was  operated  during  the  study 
period,  not  alternative  ways  of  serving  the  same  population. 

Finding  ways  to  improve  program  performance  for  those  groups  negligibly  or 
adversely  affected  by  the  current  program  will  require  experimentation  with  a  range  of 
alternative  service  strat^es  for  those  groups  and  rigorous  evaluation  of  their  impacts. 
We  cannot  overemphasize  the  importance  of  rigorous  evaluation  of  new  approaches  to 
serving  these  groups.  Experience  has  demonstrated  that  simply  trying  out  alternative 
program  strategies  without  rigorous  evaluation  is  not  enough.  As  a  National  Research 
Council  report  concluded  in  reviewing  some  400  rqwrts  on  a  wide  range  of  youth 
employment  and  training  demonstrations,  "Despite  iht  magnitude  of  the  resources 
ostensibly  devoted  to  the  objectives  of  research  and  demonstration,  there  is  little  reliable 
information  on  the  efTectiveoess  of  the  programs  b  solving  youth  employment  problems'* 
(Betsey,  Hollister,  and  Papageorgiou.  1985).  To  address  this  deficiency,  the  authors 
reoomimended  greater  reliance  on  field  experiments  with  random  assignment. 

Indeed,  the  reason  it  is  difficult  to  draw  conclusions  fix>m  studies  that  do  not  use 
random  assignment  is  clear  from  our  fmdings  on  the  control  groups  in  this  study.  The 
patterns  of  control  group  earnings  over  the  18-month  follow-up  period  demonstrate  that 
even  without  access  to  JTPA  both  adults  and  youths  would  have  experienced  a  growth  in 
eam'mgs,  and  their  earnings  would  have  varied  substantially  across  the  three  service 
strategies.  In  other  words,  if  one  looks  only  at  the  post-program  earnings  and  employment 
of  program  participants,  one  can  easily  mistake  patterns  of  outcomes  that  would  have 
occurred  anyway  for  impacts  of  the  program. 

Finally,  although  the  findings  presented  here  clearly  reveal  a  need  for  some  program 
changes,  the  full  findtnp  of  the  National  ITPA  Study  have  not  been  obuined.  Our 
forthcoming  final  report  will  extend  the  analysis  in  several  ways.  First,  we  will  estimate 
program  impacts  on  earnings,  employment,  and  educational  attainment  over  a  longer 
follow-up  period.  Growth  or  decline  in  the  impacts  during  the  period  beyond  18  months 
could  materially  alter  tf>e  differences  b  estimated  impacts  among  target  groups,  service 
strategy  subgroups,  and  other  key  subgroups  that  we  have  observed  thus  far.  Second,  we 
will  also  bdude  estimated  impacu  on  the  receipt  of  AFDC  and  food  stamp  benefits.  Third, 
and  most  important,  we  will  compare  the  impacts  and  costs  of  JTPA  Title  II-A  and  its  three 
service  strategies,  to  determine  the  Qpst-cffcaiveness  of  the  program  at  the  16  study  sites. 
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Mrs.  Thurman  [presiding].  Thank  you,  Mr.  Orr.  We  have  a  series 
of  questions,  and  I  will  start  with  Mr.  Crawford. 

You  recommend  that  the  Labor  Department  take  a  more  active 
role  in  overseeing  the  JTPA  program  and  in  using  its  expanded 
data  svstem  to  manage  the  program.  Can  you  give  us  some  exam- 
ples of  what  DOL  should  be  doing? 

Mr.  Crawford,  In  taking  a  look  at  that  more  active  role  for  the 
Department,  I  think  part  of  what  the  Department  should  be  doing 
is  in  the  area  of  regulation — getting  the  regulations  written,  get- 
ting those  regulations  out  to  the  service  delivery  areas  and  to  the 
States,  to  clarify  issues,  to  help  them. 

I  think  also  part  of  the  issue  is  within  the  area  of  oversight.  As 
I  had  mentioned  in  my  statement,  the  lack  of  sufficient  oversight 
in  some  cases  has  allowed  SDA's  to  overcharge  administrative 
costs,  to  have  excessive  OJT  periods,  to  award  contracts  payments 
without  having  them  fully  documented. 

In  this  oversight  role,  I  think  that  the  Department  needs  to  work 
very  carefully  with  the  States  in  coordinating  the  oversight  and 
support  to  the  local  SDA's.  I  think  that  the  data  system  will  afford 
the  Department,  the  States,  and  the  SDA's  to  do  some  of  the  things 
that  Larry  was  just  suggesting  in  terms  of  recognizing  that  we  can- 
not wait  another  2  or  3  years  for  results  but,  with  the  improved 
data  system,  we  can  begin  to  look  at  what  is  happening  to  some 
of  the  segments  of  the  population  that  are  having  a  problem  and 
try  to  figure  out  what  kinds  of  interim  adjustments  can  be  made. 

It  can  also  serve  as  an  opportunity  for  the  Department,  working 
with  the  States  again,  to  identify,  let's  say,  SDA's  that  may  be  hav- 
ing problems,  maybe  in  more  of  a  proactive  fashion,  to  provide 
technical  assistance  and  to  maybe  even  disseminate  some  of  the 
good  ideas  that  are  being  implemented  at  the  State  and  local  level. 

Mrs.  Thurman.  Mr.  Crawford,  do  you  believe  that  DOL  has 
enough  resources  now  to  oversee  the  JTPA  program?  I  find  that  a 
difficult  question  to  ask  after  hearing  about  65  programs  and  the 
amount  of  money  spent. 

Mr.  Crawford.  Concerning  the  issue  of  funding  for  the  Depart- 
ment, we  have  not  looked  at  that  so,  to  respond  in  terms  of  wheth- 
er the  Department  has  the  money,  the  resources  to  do  that,  I  think 
would  be  inappropriate  for  us.  We  would  prefer  to  defer  that  to  the 
Department  to  respond  to. 

Mrs.  Thurman.  The  ABT  study  draws  disturbing  conclusions 
about  job  training  for  youth.  Have  your  studies  shown  the  same 
conclusions? 

Mr.  Crawford.  Yes,  we  have  found  similar  instances,  and  I  will 
have  Mr.  Nilsen  just  give  a  couple  of  examples. 

Mr.  Nilsen.  As  was  noted  in  our  testimony,  we  were  not  sur- 
prised by  the  results  of  the  ABT  study.  We  found,  both  for  adults 
and  youth,  less-intensive  services  for  people  we  called  less  job 
ready,  people  who  you  would  think  would  get  more  intensive  serv- 
ices— people  without  recent  work  histories,  people  who  were  drop- 
outs— and  this  applied  to  both  youth  and  adults  as  well. 

Mrs.  Thurman.  Mr.  Machtley. 

Mr.  Machtley.  I  have  just  a  couple  of  questions. 

One  of  the  things  that  I  think  concerns  me  about  any  Federal 
program  that  is  established  is  that  we  don't  seem  to  have  bench- 
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marks  in  which  to  measure  it  as  it  is  proceeding  along.  We  seem 
to  bootstrap  ourself  into  some  assessment  of  its  success  based  on 
what  we  find  in  the  conclusion  studies. 

Are  there  currently  adequate  objective  benchmarks  in  the  JTPA 
program  so  that  a  year  fi"om  now  we'll  come  back  here  and  we  can 
measure  whether  or  not,  on  a  cost-effective  basis,  it  was  worth  in- 
vesting $1.8  billion  in  order  to  help  the  targeted  population? 

I'm  specifically  concerned  because,  when  I  read  the  findings,  for 
people  who  were  geared  toward  the  wage  impact  or  the  economic 
impact  or  the  educational  impact,  it  doesn't  look  like  they  justify 
the  cost.  It's  a  great  concern  when  you  find  that,  because  the 
participatoiy  employment  figure  was  70  percent  when  you  went 
back,  that  that  was  really  not  a  true  indication  of  how  many  people 
were  successful  in  employment. 

What  is  the  benchmark  that  has  been  established,  if  any  and,  if 
not,  why  not? 

Mr.  Gerald  Peterson.  I'll  take  a  quick  shot  at  it.  Even  the  new 
reporting  system  that  is  being  developed — not  the  one  that  was  in 
place  when  we  looked  at  it,  but  the  new  reporting  system — still  will 
not  collect  data  that  we  feel  is  very  important  and  the  Congress 
have  felt  is  very  important. 

For  instance,  the  reduction  in  welfare — that  figure  still  will  not 
be  collected.  So  even  the  new  reporting  system  that  ETA  will  be 
talking  to  you  about  later  in  the  morning  will  not  be  collecting  data 
that  important. 

So,  in  terms  of  a  cost  effectiveness  measurement  of  this  program, 
that  is  not  in  the  design  format  at  this  point  in  time.  Tnerefore, 
you  are  not  going  to  be  able  to  make  a  cost  effectiveness  determina- 
tion. 

Mr.  Machtley.  Maybe  I've  made  it  too  complicated.  Has  the 
JTPA  said:  "A  year  from  now,  here  are  the  criteria  on  which  you 
measure  our  success"?  Have  they  benchmarked  themselves  objec- 
tively so  that  we  can  assess  how  successful  they  are?  As  you  are 
saying,  collecting  data  after  they  have  been  in  existence  is  not  a 
very  good  way  of  determining  success,  it  seems  to  me.  You  have  to 
benchmark. 

Mr.  Crawford.  I  think  perhaps  maybe  I  can  help.  The  perform- 
ance measure  standards  that  JTPA  has  in  place  provides  a  meas- 
ure of  the  numbers  of  people  placed  and  wages.  Their  improve- 
ments in  their  data  reporting  will  be  good. 

Part  of  what  we  were  arguing  for  is  a  more  systematic  approach 
to  gathering  data  with  an  understanding  of  figuring  out  what 
works  and  figuring  out  what  we  would  need  to  do  to  get  there,  and 
we  think  that  strategy  would  include  more  in  the  way  of  measuring 
impact  by  gathering  oaseline  data  and  then  making  adjustments  in 
the  kinds  of  information  that  JTPA  routinely  collects. 

So  I  think  it  is  more  of  a  position  or  a  philosophy  in  terms  of 
knowing  where  you  want  to  go  and  being  able  to  measure  how  well 
you  are  doing  and  then  being  able  to  then  make  necessary  adjust- 
ments. It's  not  clear  that  is  where  we  are  headed  in  a  systematic 
fashion. 

Mr.  Machtley.  Is  there  any  problem  in  establishing — whether 
we  all  agree  or  not  agree — but  establishing  somehow  a  benchmark? 
In  other  words,  we  say:  "Look,  we  want  the  earning  add-on  value 
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to  be  increased  by  5  percent  for  the  people  who  participate."  I  see 
that  some  of  the  graduation  or  GED  or  diploma  rates  have  doubled. 

If  you  have  5  percent  and  it  makes  10  percent,  that  is  not  a  great 
record,  but  if  you  say,  "we  want  it  to  be  30  percent  of  all  those  who 
participate"  or  "we  want  it  to  be  50  percent,"  whatever  the  number, 
at  least  a  year  from  now  we  can  say,  "yes,  we  were  successful  in 
meeting  the  goals  of  the  Job  Training  Partnership  Act"  or,  "we 
weren't  successful  and  therefore  we  ought  to  go  back  and  see  why 
we  did  not  reach  the  goals  which  the  administrators  of  the  program 
set  themselves." 

I  get  the  sense  that  we  are  just  wandering  around  spending  $1.8 
billion  and  some  day  we  may  do  a  study  and  find  out  what  works, 
but  probably  we  will  just  say,  "boy,  that  didn't  work." 

Mr.  Orr.  Sir,  if  I  could  respond  to  that?  The  program  does  have 
well-defined  performance  standards  and,  as  Mr.  Crawford  indi- 
cated, they  are  intended  to  ensure  a  certain  level  of  efficiency  in 
the  program.  For  example,  standards  are  set  on  the  number  of  par- 
ticipants who  are  placed  in  jobs.  If  the  program  doesn't  do  that,  it 
is  not  functioning  properly. 

Unfortunately,  that  kind  of  standard  doesn't  do  the  kind  of  thing 
that  you  were  alluding  to  a  minute  ago — ensuring  that  the  program 
increases  the  employment  and  earnings  of  the  participants  as  com- 
pared to  what  they  would  have  achieved  if  they  hadn't  gone 
through  the  program.  After  all,  many  people  who  become  unem- 
ployed do  not  go  to  JTPA,  and  still  find  jobs  and  become  employed 
again  and  have  reasonable  earnings. 

The  only  way  to  measure  that  kind  of  value  added,  at  least  the 
only  way  that  we  know,  is  to  do  the  kind  of  random  assignment 
control  gr^oup  impact  evaluation  that  we  have  done  and,  unfortu- 
nately, one  cannot  do  that  in  every  SDA  in  the  country.  It's  a  big, 
complex  undertaking.  One  can  only  do  it  periodically.  It  takes  a  lot 
of  time,  because  you  then  have  to  follow  these  people  for  several 
years  to  find  out  what  the  longer  term  impacts  were. 

I  would  like  to  be  able  to  give  you  a  neater,  cleaner,  simpler  pre- 
scription for  making  the  program  work,  but  that  is  my  view  of  the 
problem  of  doing  what  you  are  suggesting. 

I  think  the  current  performance  standards  that  focus  on  effi- 
ciency may  be  about  the  best  one  we  can  do  in  the  situation,  along 
with  periodic  attempts  to  measure  the  value-added  impacts. 

Mr.  Gerald  Peterson.  Except  the  law  mandated  sort  of  a  "be- 
fore and  after"  kind  of  a  look  at  a  person.  That  is  to  say.  Congress 
said  that  this  is  an  investment  in  human  capital  and  the  return 
on  investment  should  be  measured  in  terms  of  added  income  or  de- 
crease in  dependency  on  welfare  and,  10  years  later,  even  that  sim- 
ple kind  of  measurement  has  not  been  put  in  place. 

They  are  not  measuring  the  before  and  after.  They  are  not  meas- 
uring the  impact  on  welmre.  So  I  think  it  is  time  that,  these  two 
factors  at  least,  be  measured.  This  is  something  that  is  do-able. 

Mr.  Machtley.  Well,  I  think  that  there  are  measurements.  I  just 
don't  believe  efficiency  is  the  only  way  to  measure  a  program.  It 
may  be  more  efficient  to  give  everyone  $900,  but  I  dont  think 
that's  the  goal  of  the  program. 

So  I  think  we  have  to  figure  out  a  way  to  have  these  specific 
whatever  they  are — and  the  people  in  the  JTPA  ought  to  be  able 
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to  come  up  with  their  own  measurement  tools — whether  it  is  how 
many  people  have  gotten  off  welfare,  how  many  people  have  im- 
proved their  education,  and  have  a  goal  in  advance,  and  then  see 
how  we  have  reached  that  goal.  So  I  hope  that  they  are  going  to 
work  toward  it. 

Mr.  Peterson  [presiding].  To  follow  up  on  that,  in  your  testi- 
mony you  were  talking  about  that  determining  a  total  investment 
for  each  participant  was  impossible.  You  just  stated  now  that  they 
cannot  tell  how  many  people  that  were  on  welfare  and  are  off,  and 
so  forth. 

I  went  out  and  looked  at  the  JTPA  program  in  my  district  and, 
in  that  particular  program,  they  have  every  bit  of  this  information. 
They  know  every  single  day,  every  piece  of  information  you  could 
ever  want  about  these  people.  It  is  all  there. 

Mr.  Gerald  Peterson.  Mr.  Chairman,  oftentimes  you  will  find 
that  done  even  on  a  statewide  basis,  but  it  is  not  collected  and  ana- 
lyzed from  a  national  perspective. 

Mr.  Peterson.  Why  not? 

Mr.  Gerald  Peterson.  I  think  that  question  needs  to  be  directed 
to  ETA.  They  operate  the  program  and  they  have  said  repeatedly 
that  they  just  can't  get  hold  of  the  information  on  reductions  in 
welfare.  Why  that  is,  I  think  that  they  are  in  a  better  position  to 
address. 

Mr.  Peterson.  So  you  will  admit,  then,  that  the  information  is 
there? 

Mr.  Gerald  Peterson.  Oftentimes  we  find  the  information 
available. 

Mr.  Peterson.  Do  you  have  any  idea  of  how  often  it  is  there  and 
how  often  it  isn't?  Is  it  there  in  60  percent  of  the  programs,  or  do 
you  have  any  kind  of  sense  of  that? 

Mr.  Gerald  Peterson.  I  think  actually  it  is  rather  an  excep- 
tional case  when  it  isn't  available.  The  individual  programs  will 
most  often — certainly  over  half  the  time — ^have  that  kind  of  data 
available,  and  sometimes  being  analyzed  at  that  level. 

The  problem  with  it  is  that  it  is  not  being  collected  on  a  national 
level,  and  you  can't  make  conclusions  with  any  degree  of  certainty. 

Mr.  Peterson.  One  of  the  reasons  for  decentralizing  this  was  to 
try  to  give  the  States  more  flexibility,  more  control.  Shouldn't  they 
be  collecting  this  stuff  on  a  State-by-State  basis  if  they  are  the  ones 
that  are,  in  effect,  managing  these  SDA's? 

Mr.  Gerald  Peterson.  I  think  ideally  the  partnership,  that  is  to 
say  the  Federal-State-local  partnership,  should  each  have  that  data 
available  to  them  so  that  each  level  can  make  some  judgments  and 
fine  tune  the  program.  That  would  also  involve  the  Congress.  The 
Congress  ought  to  have  that  kind  of  data  available  to  them. 

Mr.  Peterson.  Is  this  data  getting  up  to  the  State  level?  Do  they 
have  this  information? 

Mr.  Gerald  Peterson.  It's  a  mixed  bag,  sir. 

Mr.  Peterson.  Some  States  do  and  some  do  not? 

Mr.  Gerald  Peterson.  Most  often,  it  is  not  getting  to  the  State 
level.  Most  often  it  is  not. 

Mr.  Peterson.  So  that  is  where  it  is  breaking  down? 
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Mr.  Gerald  Peterson.  I  think  where  it  is  breaking  down  is  that 
there  is  not  a  strategy  for  the  collection  of  that  data.  There  is  not 
a  partnership. 

Mr.  Peterson.  So  the  problem  goes  back  up  to  the  ETA? 

Mr.  Gerald  Peterson.  It  goes  back  up  to  the  Federal  level. 

Mr.  Peterson.  Do  you  agree  with  this,  what  we  are  just  talking 
about  here,  Mr.  Nil  sen  or  Mr.  Crawford? 

Mr.  Crawford.  I  think  overall  we  would  agree  that  one  of  the 
disadvantages  to  the  hands-oflf  approach,  is  that  there  is  an  un- 
evenness  with  the  States  and  at  the  SDA  level  in  terms  of  what 
you  can  find,  how  active — certain  States  are  more  active  and  have 
better  oversight.  Certain  SDA's  are  more  active,  creative.  But 
again,  it  is  the  unevenness  that  exists. 

Mr.  Peterson.  One  other  thing.  When  you  went  out  and  looked, 
what  kind  of  a  sample  did  you  look  at? 

Mr.  Gerald  Peterson.  In  our  audit,  sir,  we  went  to,  I  think  35 
different  SDA's. 

Mr.  Peterson.  Were  they  scattered  all  over  the  country? 

Mr.  Gerald  Peterson.  They  were  scattered  all  over  and  were 
randomly  selected.  Our  report,  unlike  the  ABT  report,  concentrates 
strongly  on  the  inner  city — the  urban  area.  I  think,  for  the  most 
part,  the  ABT  study  has  missed  the  urban  area  entirely. 

Mr.  Orr.  That  is  not  entirely  true. 

Mr.  Gerald  Peterson.  A  major  urban  area?  I'm  not  sure.  But, 
at  any  rate,  as  I  remember,  they  didn't  hit  a  major  urban  area. 

We  started  our  sample  with  1,750  participants — 50  from  each  of 
the  SDA's.  That  was  what  we  looked  at. 

Mr.  Peterson.  Does  it  say  which  35  this  is  in  your  report? 

Mr.  Gerald  Peterson.  Yes.  The  SDA's  are  in  the  report. 

Mr.  Peterson.  OK 

Mr.  Gerald  Peterson.  Or,  if  they  are  not  in  the  report,  I  will 
make  them  available.  I  think  they  are  in  the  report. 

Mr.  Peterson.  I  guess  I  would  be  interested  in  knowing  that. 

Mr.  Masten.  Yes,  they  are  in  the  report. 

Mr.  Peterson.  I  obviously  haven't  read  it  in  that  detail.  Were 
you  going  to  say  something? 

Mr.  Crawford.  I  was  just  going  to  mention,  just  highlight  some 
of  the  coverages  that  we  have  had,  in  terms  of  the  SDA's.  Mr. 
Medvetz. 

Mr.  Medvetz.  Yes.  We  have  carried  out  some — well,  one  exten- 
sive study,  in  which  we  visited  63  SDA's,  and  we  agree  with  Mr. 
Peterson  that  the  recordkeeping  at  the  SDA  level  was  very  incon- 
sistent. Some  of  the  SDA's  had  very  accurate  and  complete  records 
and  others  we  had  to  reconstruct  everything  that  we  did. 

Mr.  Peterson.  You  had  to  reconstruct  it? 

Mr.  Medvetz.  Yes.  By  digging  through  participant  files  and 
other  work. 

Mr.  Peterson.  What  kind  of  records  do  they  have,  just  financial 
records? 

Mr.  Medvetz.  The  problem  was  the  consistency. 

Mr.  Peterson.  And  again,  because  the  ETA  has  not  told  people 
how  to  put  this  together?  Is  that  what  it  is? 

Mr.  Medvetz.  Yes. 
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Mr.  Peterson.  There  is  no  standardized  format?  Everybody  has 
kind  of  developed  this  on  their  own? 

Mr.  Medvetz.  Yes. 

Mr,  Peterson.  Does  anybody  know  why  that  is? 

Mr.  Gerald  Peterson.  Sir,  I  would  like  to  just  say  that  I  do 
think  the  1992  amendments  are  going  to  significantly  impact  that. 
I  believe  GAO  would  agree  that,  oetween  us,  we  got  90  percent  of 
what  we  asked  to  be  included  in  the  1992  amendments. 

Mr.  Peterson.  How  long  is  it  going  to  take  for  those  to  take  hold 
so  we  know  whether  we  have  this  under  control  or  not? 

Mr.  Gerald  Peterson.  Now,  you're  asking  the  tough  questions. 
[Laughter.] 

I  think  they  are  to  be  implemented  as  of  July  of  this  year,  and 
my  guess  is  that  because  of  the  detail— there  is  a  significant 
change,  a  very  significant  change — I  would  guess  it  is  going  to  take 
about  12  months  for  them  to  be  fully  integrated  into  the  various 
SDA  systems. 

Mr.  Peterson.  Mr.  Rush,  if  you  want  to  ask  questions,  we  will 
recognize  you  now. 

Mr.  Rush.  I  have  to  go  now. 

Mr.  Peterson.  Well,  we  appreciate  you  stopping  by. 

Mr.  Rush.  Thank  you. 

Mr.  Peterson.  So  it  is  going  to  be  implemented  July  1,  and  it 
is  going  to  take  12  months.  That  will  be  July  1,  1994.  And  it  will 
take  6  months  for  you  to  figure  out  what  happened.  So  we  are  look- 
ing at  January  1,  1995,  before  we  know? 

Mr.  Gerald  Peterson.  That  is  probably  a  good  date. 

Mr.  Peterson.  Will  we  know  anything  before  that? 

Mr.  Gerald  Peterson.  Well,  we  are  going  to  know  something. 
We  are  going  to  be  down  in  those  SDA's  at  some  level.  However, 
the  impact  of  the  changes,  I  think,  you  are  not  going  to  know  a 
great  deal  about  until  then.  Some  of  the  SDA's,  of  course,  will  move 
much  faster  than  others. 

Some  of  them,  for  all  intents  and  purposes,  I  think  ETA  would 
tell  you  and  my  staff  would  tell  you,  have  implemented  them  now. 
Agam,  it  is  a  very  inconsistent  bag  out  there. 

I  think,  in  fairness  to  the  system,  I  don't  think  you  could  meas- 
ure it  systemwide  until  about  1995. 

Mr.  Peterson.  These  States,  every  State  has  some  kind  of  orga- 
nization that  controls  the  SDA's  in  their  State;  is  that  correct? 

Mr.  Gerald  Peterson.  That  is  correct. 

Mr.  Peterson.  What  are  they  doing?  Why  aren't  they  weighing 
in  on  this?  If  they  wanted  this  responsibility,  why  aren't  they  help- 
ing to — in  all  cases,  helping  to  implement  it? 

Mr.  Gerald  Peterson.  I  think  it  is  inconsistent  again.  But,  for 
the  most  part — and  it  is  bad,  sometimes,  to  generalize — but,  for  the 
most  part,  I  think  the  States  did  not  step  in  as  was  envisioned  in 
1982.  I  think  we  envisioned  that  the  States  would  step  in  and  take 
over  the  role  ETA  had  played  in  the  past.  I  think,  for  the  most 
part,  that  simply  did  not  happen. 

ETA  reduced  their  staff,  as  you  know,  very  considerably.  And  I, 
for  one,  would  not  be  bashful  to  tell  you  that  I  do  not  think  ETA 
has  the  resources  to  carry  out  the  oversight 

Mr.  Peterson.  Right  now? 
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Mr.  Gerald  Peterson  [continuing].  Right  now,  I  don't  think 
they  have  it.  I  think  that  they  are  spread  very  thin  and  are  going 
to  need  some  help. 

Mr.  Peterson.  Do  the  States  have  the  resources? 

Mr.  Gerald  Peterson.  Again,  the  States  did  not  build  up  the  re- 
source that  was  expected  to  take  place. 

Mr.  Peterson.  Should  we  undo  that?  Should  we  take  the  States 
out  of  this? 

Mr.  Gerald  Peterson.  I  think  that  is  a  question  for  someone  be- 
sides me. 

Mr.  Peterson.  You  don't  have  an  opinion? 

Mr.  Gerald  Peterson.  I  have  an  opinion.  I  think  the  States 
should  be  in  it.  I  think  it  was  hopeful  thinking,  however,  that  they 
would  react  to  it  rapidly  and  provide  the  kind  of  oversight  that 
ETA  had  provided.  It  just  did  not  happen.  At  least,  it  did  not  hap- 
pen uniformly. 

That  vacuum  has  been  there  for  the  past  10  years,  and  I  am  not 
sure  that  we  can  correct  it  without  giving  the  ETA  some  resources 
to  provide  a  more  active  Federal  role. 

Mrs.  Thurman.  Mr.  Chairman. 

Mr.  Peterson.  Mrs.  Thurman. 

Mrs.  Thurman.  Will  you  yield  for  a  second? 

Mr.  Peterson.  Yes.  Go  ahead. 

Mrs.  Thurman,  One  of  the  components  that  I  see  missing  here 
in  evaluating  all  of  this — and  we  do  a  lot  of  percentages,  we  do  a 
lot  of  numbers — at  the  same  time,  between  the  1982  to  1992,  there 
was  also  a  tremendous  job  loss  around  the  country.  Economics 
played  into  this  as  far  as  where  and  who  could  be  placed,  how  they 
could  be  placed. 

Is  that  a  part  of  this  report?  I  think  that  is  a  component,  espe- 
cially when  I  think  of  Florida,  where  unemployment  rose  dramati- 
cally. It's  hard  to  place  somebody  if  you  do  not  have  the  jobs  to 
place  them  in  to  go  to  or  to  bring  them  to  a  higher  level  job. 

We  saw  businesses  failing  during  this  time,  so  there  was  again 
no  placement,  and  there  certainly  was  no  room  for  improvement  for 
wages. 

Can  any  of  you  respond  to  how  that  fact  plays  into  these  particu- 
lar programs? 

Mr.  Orr.  I  could  respond  with  respect  to  our  own  study.  You  are 
absolutely  right,  that  the  state  of  the  local  labor  market  may  have 
a  strong  influence  on  what  the  program  can  do  with  a  particular 
individual. 

In  our  study,  we  were  able  to  at  least  take  that  into  account  to 
the  extent  that  we  were  comparing  the  JTPA  participants  with  a 
set  of  control  group  members  who  faced  the  same  labor  market  con- 
ditions. So  the  question  we  were  asking  was,  even  in  a  bad  labor 
market,  was  the  program  able  to  help  its  participants  do  better 
than  they  would  have  without  the  program?  The  study  sites  also 
represented  a  fairly  wide  range  of  unemployment  levels  in  the  local 
labor  market.  This  allowed  us  to  look  at  the  variation  in  program 
effectiveness  across  sites  with  different  unemployment  levels.  Now, 
unfortunately,  when  you  get  down  to  that  level,  we  had  fairly  small 
samples  in  each  site,  so  it  was  not  a  terribly  refined  test.  We  did 
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not  find  any  significant  difference  in  the  way  the  program  func- 
tioned in  low  unemployment  sites  versus  hi^h  unemployment  sites. 

In  other  words,  we  were  not  finding  significantly  better  impacts 
in  the  low  unemployment  sites  than  we  found  in  the  high  unem- 
ployment sites. 

Mr.  Peterson.  Besides  that,  we  were  supposed  to  have  this  big 
economic  boom  during  that  time.  We  created  how  many  millions  of 
jobs? 

Mrs.  Thurman.  I  just  thought  I  would  bring  that  up  just  because 
of  that  particular  circumstance.  [Laughter.] 

Mr.  Gerald  Peterson.  I  think  maybe  the  bigger  problem  is  the 
fact  that  we  have  very  little  money  going  to  skill  training.  I  think 
the  most  alarming  part  of  our  report  is  that  when  you  look  at  the 
money  that  actually  goes  toward  enhancing  a  person's  skill  level, 
it  is  only  around  $900  or  $1,000.  So,  regardless  of  what  your  job 
market  is,  you  are  not  going  to  buy  very  much  enhanced  skill  level 
with  that  kind  of  money. 

Remember  that  we  reduced  drastically  the  amount  of  money 
going  for  training  purposes  when  we  went  from  CETA  to  JTPA.  We 
added  a  level  of  administration — ^the  State — so  that  the  administra- 
tive costs  of  the  program  went  up.  The  portion  of  money  that  actu- 
ally goes  to  the  added  value  of  the  person,  the  skill  level  of  the  per- 
son, has  eroded. 

You  can  find  some  great  successes  in  the  program,  but  most  of 
those  successes  that  you  find  and  you  say,  "Gee,  that  is  what  the 
program  really  should  do,"  you  are  talking  about  an  expenditure  of 
maybe  $10,000.  You  are  not  talking  about  $1,000  or  $900  anv 
more.  Currently,  you  are  not  buying  a  whole  lot  of  training  with 
this  program. 

Mr.  PiiTERSON.  You  just  said  again  that  the  States  created  more 
management  costs  and  you  are  saying  we  did  not  get  anything  out 
of  that.  So  why  should  we  keep  the  States  in  this?  If  they  are  not 
going  to  help  us  do  part  of  this  job,  aren't  they  getting  in  the  way? 

Mr.  Gerald  Peterson.  I  guess  because  you  nave  to  think  that 
this  is  a  State  problem  as  well  as  a  city,  local,  as  well  as  a  Federal 
problem.  I  think  various  levels  of  government  certainly  need  to  be 
concerned  about  this  problem. 

Mr.  Peterson.  Are  the  States  putting  anything  of  any  signifi- 
cance into  this  beyond  funding  administrative  positions? 

Mr.  Gerald  Peterson.  Again,  ETA  may  be  in  a  better  position 
to  answer  that. 

Mr.  Peterson.  I  think  maybe  some  States  are  doing  some  things, 
probably. 

Mr.  Gerald  Peterson.  They  may  be.  They  may  be. 

Mr.  Peterson.  But  I  suppose  it's  all  over  the  map.  Does  the  GAO 
agree  that  the  States  have  not  really  weighed  in  and  provided 
much  management  and  oversight?  Do  you  agree  with  that  assess- 
ment? 

Mr.  Crawford.  Generally,  I  think  we  would.  I  think  that,  again, 
the  Department  has  not  provided  the  leadership,  has  not  called 
upon  the  States,  in  many  instances,  to  do  this.  I  think,  as  part  of 
that  issue  of  weighing  what  to  do,  the  States  do,  to  some  degree, 
vary  and  it's  uneven  in  the  extent  to  which  they  are  involved  in 
oversight  and  monitoring. 
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If  you  eliminate  the  States,  if  that  is  one  of  the  considerations, 
then  the  question  becomes,  would  you  have  to  perhaps  considerably 
enhance  the  Federal  level  to  be  able  to  pick  up  the  slack  and  to 
also  do  those  additional  things  that  you  feel  that  the  States  should 
be  doing. 

I  think  the  States,  if  they  are  involved,  should  have  a  value- 
added  role.  I  think  anyone  involved  should  have  a  value-added  role. 

Mr.  Peterson.  Does  the  Department  of  Labor  have  enough  re- 
sources to  manage  this  and  oversee  this? 

Mr.  Crawford.  We  did  not  look  at  that,  at  the  resource  level 
within  the  Department  and,  therefore,  I  am  really  not  in  a  position 
to  comment  on  that.  I  think  if  you  are  proposing  to  give  them  sub- 
stantially enhanced  responsibilities,  then  the  resource  issue  may  be 
something  that  you  very  seriously  have  to  look  at. 

Mr.  Peterson.  In  the  1992  amendments — and  I  wasn't  that  in- 
volved in  those  and  am  probably  not  up  to  speed  as  much  as  I 
should  be — thev  were,  I  gather,  not  really  given  any  more  resources 
to  implement  tnose? 

Mr.  Crawford.  I  don't  think  so. 

Mr.  Gerald  Peterson.  Not  to  the  best  of  my  knowledge.  They 
certainly  are  given  a  bigger  role. 

Mr.  Peterson.  Right.  But  they  were  not  given  any  resources. 

Mr.  Gerald  Peterson.  Again,  ETA  can  better  address  that.  I  am 
sure  they  will  be  happy  to  discuss  that.  But  I  know  that  they  have 
an  enhanced  role. 

Mr.  Peterson.  I  have  some  other  questions  here,  but  maybe  we 
ought  to  just  submit  those  to  you  in  writing  and  we  can  move  along 
here,  so  we  don't  run  out  of  time. 

I  appreciate  your  being  with  us.  Your  testimony  and  your  an- 
swers to  the  questions  were  useful,  and  we  will  probably  continue 
to  focus  in  on  this  as  we  move  along  here.  Thank  you  all  very 
much. 

I  call  the  next  panel.  We  have  William  Struever,  who  is  a  part- 
ner in  Struever  Brothers,  Eccles  &  Rouse  in  Baltimore,  and  a  mem- 
ber of  the  Maryland  State  Governor's  Investment  Board;  Patricia 
Irving,  president  and  CEO  of  the  Philadelphia  PIC;  and  John  Zel- 
ler,  executive  director  of  the  Montgomery  County  PIC  and  Jon  A. 
Gerson,  director  of  economic  development  for  Montgomery  County. 
If  you  would  all  come  up. 

As  is  the  custom,  we  swear  in  all  of  our  witnesses,  if  you  don't 
mind.  So,  please  stand. 

[Witnesses  sworn.] 

Mr.  Peterson.  Before  we  start,  we  were  also  going  to  have  Mr. 
Larry  Buboltz,  who  runs  Rural  Minnesota  SEP  in  my  district  be 
with  us,  but  he  came  down  with  some  kind  of  a  head  cold  or  what- 
ever, and  they  did  not  want  him  to  fly.  He  does  have  some  testi- 
mony, which  I  would  like  to  make  part  of  the  record. 

One  of  the  reasons  we  wanted  nim  to  be  here  was  that  he  has 
one  of  the  outfits  in  the  country  that  does  not  operate  underneath 
the  SDA.  They  operate  directly,  for  whatever  reason  and,  in  my 
opinion,  do  a  pretty  good  job.  So  we  will  make  his  testimony  and 
the  information  available,  without  objection. 

[The  prepared  statement  of  Mr.  Buboltz  may  be  found  in  the  ap- 
pendix.] 
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Mr.  Peterson.  We  will  start  off  with  Mr.  Struever.  Welcome  to 
the  committee,  and  we  look  forward  to  hearing  your  testimony. 

STATEMENT  OF  WILLIAM  STRUEVER,  PRESIDENT,  STRUEVER 
BROTHERS,  ECCLES  &  ROUSE,  BALTIMORE,  MD,  AND  MEM- 
BER, MARYLAND  STATE  GOVERNOR'S  INVESTMENT  BOARD 

Mr.  Struever.  Thank  you.  A  little  background.  I  am  a  master 
electrician  that  turned  builder  that  turned  developer,  and  if  the 
real  estate  market  in  America  doesn't  get  any  better,  I  will  be  back 
being  an  electrician  again. 

My  experience  in  the  job  training  business  goes  back  to  the  be- 
ginning of  private  industry  councils  in  1978  under  CETA  when  I 
was  appointed  to  the  Baltimore  PIC.  I  actually  had  a  chance,  in 
1982,  to  sit  with  the  President  in  the  oval  office  right  before  sign- 
ing the  JTPA  legislation  with  a  group  of  CETA  trainees  and  talk- 
ing about  the  bill,  so  I  got  in  on  the  beginning. 

It  was  a  testimony  to  the  bipartisan  nature  of  this  whole  job 
training  effort,  which  I  think  is  absolutely  critical.  I'm  a  diehard 
Democrat  and,  somehow,  Reagan  got  me  in  there  for  the  bill  sign- 
ing, which  is  a  wonderful  thing — Democrats  and  Republicans  work- 
ing together  on  this. 

I  was  chair  of  the  Baltimore  PIC.  I  remain  active  on  the  State 
coordinating  council.  We  call  it  our  Grovernor's  work  force  invest- 
ment board.  Before  that,  I  was  chair  of  the  education  and  then 
youth  policy  committees.  I  am  on  the  board  of  the  National  Associa- 
tion of  Private  Industry  Councils  and  am  currently  chair  of  the 
U.S.  Basic  Skills  Corp.,  which  is  a  big  literacy  nonprofit  foundation 
doing  work  around  the  country. 

I  mention  this  because  of  the  importance  of  coming  to  the  issue 
of  how  well  JTPA  is  doing  from  a  broad  perspective,  both  in  terms 
of  the  kind  of  things  it  does  and  historically  looking  back,  as  we 
have  been  in  this  business  for  a  long  time  now.  It  is  always,  as  a 
businessperson,  one  of  my  great  fi*ustrations  with  government  is 
how  we  can  build  on  experience  instead  of  constantly,  every  4 
years,  throwing  things  out  because  it's  Democrat  or  Republican  and 
starting  over  again,  instead  of  trying  to  build  on  that  experience 
and  do  better. 

I  will  try,  quickly,  to  touch  on  the  questions  you  have  asked 
about  the  important  features  of  JTPA  and  the  role  of  PIC's  and 
State  councils  and  some  of  the  successes  and  some  of  the  problems 
we  have  had,  and  who  we  try  to  serve,  and  then  try  to  end  up  on 
some  key  issues  looking  forward. 

On  the  strengths  of  JTPA,  No.  1  is  the  partnership.  This  oppor- 
tunity to  bring  business  and  labor  and  government  together  in  a 
real  way  is  tremendously  important. 

A  second  key  part  of  JTPA  is  the  effort  to  work  together  in  an 
integrated  way  across  agency  and  program  boundaries  so  you  don't 
care  whether  it  is  this  thing  or  that  thing,  but  you  care  about  what 
comes  out.  Ultimately,  the  third  feature  being  the  performance- 
based  outcome  driven  nature  of  JTPA  is  really  the  most  important 
part:  How  can  you  get  these  folks  so  they  can  be  self-sufficient  with 
good-quality  jobs  and  take  care  of  their  own  problems? 

Fourth,  when  you  are  talking  about  oversight,  a  big  strength  of 
JTPA  is  it  is  a  locally  managed  and  relatively  flexible  program 
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which,  given  the  tremendous  diversity — ^you  are  talking  about  the 
economy  and  what  effect  it  has  on  the  labor  market,  the  kind  of 
jobs  that  are  available  and  the  kind  of  resources  that  are  available 
in  different  communities — to  be  responsive  to  that  and  effective 
and  have  good  programs,  you  really  have  to  have  locally  based  pro- 
grams that  can  be  flexible  and  work  around  local  conditions. 

The  role  of  PIC  and  the  role  of  business:  Coming  from  the  busi- 
ness world,  I  personally  think  it  is  absolutely  wonderful  that  we 
have  created  this  opportunity  for  business  to  take  a  leadership  role 
dealing  with  a  top  economic  issue  before  the  country.  We  know 
where  the  iob  market  is  and  where  it  is  going  as  well  as  anybody. 
It  is  a  tough  thing  to  keep  track  of. 

In  many  senses,  business  is  the  customer,  the  people  that  need 
to  help  put  unemployed  folks  to  work.  The  role  of  PIC's  is  an  inter- 
agency policy  board.  The  wonderful  thing  in  our  PIC  is  that  we 
have  no  patience  for  turf,  as  to  'This  is  in  the  Welfare  Department" 
or  "This  is  over  in  Voc.  Ed."  or  "This  is  over  in  Education."  We 
don't  care.  We  all  sit  around  the  table  and  work  together,  and  that 
is  how  we  see  our  PIC  working. 

We  are  outcome  driven.  We  ask  tough  questions  on  our  PIC.  Five 
years  ago,  we  were  really  concerned  about  the  lack  of  skills,  and 
we  needed  to  get  working  on  literacy  and  what  is  going  on  in 
schools.  So  we  forged  a  major  effort,  in  partnership  with  the  school 
system.  Now,  we  have  a  real  concern  about  what  is  happening  with 
tne  out-of-school  youth  and  we  are  really  making  a  big  push  on 
young  male  dropouts. 

That  is  the  type  of  policy  direction  that  comes  out  of  the  PIC's 
and  the  partnership  and  the  businesses  knowing  what  is  going  on, 
and  the  accountability,  which  is  a  major  part  of  what  PIC's  are 
about.  PIC's  are  also  advocates — advocates  for  investing  in  a 
proactive  way  to  solve  these  problems. 

We  have  taken  the  PIC,  our  PIC,  and  expanded  in  taking  a  larg- 
er role  in  work  force  investment  issues.  There  are  many  PIC/s 
across  the  country  doing  this. 

In  terms  of  our  State  council,  in  our  State  we  are  blessed  with 
very  strong  leadership  from  our  Governor.  He  has  his  key  cabinet 
people  on  our  council  and  on  our  executive  committee.  We  sit  down 
together  with  the  State  school  superintendent,  the  head  of  eco- 
nomic development,  the  head  of  job  training,  and  knock  heads  and 
try  to  work  things  out,  so  a  real  effort  to  coordinate.  Since  so  much 
funding  and  program  regulations  come  from  the  State  level.  State 
coordination  is  critical. 

Our  State  council  also  plays  a  key  role  in  terms  of  capacity  build- 
ing, working  with  the  12  PIC's  in  our  State  in  terms  of  helping 
them  get  better  and  smarter  about  how  to  run  effective  programs. 
The  State  council  has  been  a  very  important  tool  in  terms  of 
leveraging  State  funding  to  work  with  JTPA.  Our  PIC  gets  only 
about  naif  of  our  funding  from  JTPA  and  the  rest  comes  from  all 
kinds  of  different  sources,  including  State  moneys. 

Our  State  council  is  also  leading  the  way  nationally  in  terms  of 
this  concept  of  the  broader  role  in  work  force  investment  programs, 
which  I  am  excited  about  and  I  think  is  the  future. 

A  couple  of  successful  programs,  then  I  will  talk  about  some 
headaches  we  have. 
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Project  Independence,  which  is  our  JOBS/welfare  employment 
program.  We  had  a  jump  start,  because  we  had  a  State  welfare  em- 
ployment program  called  investment  in  job  opportunities  a  couple 
years  ahead  of  JOBS  and  we  gave  PIC's  the  lead  responsibility,  to 
convene  on  the  local  level  and  do  planning  because,  again,  the  is- 
sues are  different. 

In  some  parts  of  the  State  the  biggest  issue  is  there  are  no  cars, 
no  transportation.  How  do  you  get  people  to  work?  In  Baltimore 
City,  the  issue  is  that  nobody  can  read. 

So  each  local  PIC  was  in  charge  of  putting  the  SDA,  the  welfare 
department,  the  education  department  together,  and  coming  up 
with  our  own  plan  about  how  to  run  a  welfare  employment  pro- 
gram that  looks  at  support  services — health,  child  care,  and  trans- 
portation— what  kind  of  education  and  training  support  we  need, 
and  where  the  jobs  are,  and  job  placement. 

A  second  successful  program  model  is  in  dropout  prevention.  As 
I  mentioned  before,  we  are  tremendously  concerned  with  our  50 
percent  dropout  rate  that  we  have  in  Baltimore  City  and  not  as 
bad,  but  also  a  serious  problem  elsewhere  around  the  State. 

So  we  started,  4  years  ago  now,  a  program  that  focused  on  eighth 
graders  coming  into  high  school  that  were  doomed  to  failure.  These 
are  kids  that  were  two  grade  levels  behind.  Statistically,  over  90 
percent  would  not  graduate  without  somebody  getting  there,  ag- 
gressively intervening  and  helping  the  kids  get  on  the  straight  and 
narrow. 

That  is  what  this  program  is.  It  is  a  year-round  program.  Inten- 
sive summer,  in  school,  out  of  school.  We  have  counselors  for  every 
25  kids,  that  are  those  kids'  advocates  in  making  sure  they  show 
up  to  school  and  working  with  their  families.  A  wonderful  program. 

What  doesn't  work?  I  think — constantly  looking  at  your  outcome- 
based  programs  and  talking  about  all  these  statistics  and  stuff  that 
the  IG  and  everybody  was  talking  about  a  minute  ago — ^it  really 
comes  down  to,  when  you  are  sitting  down  in  your  PIC,  talking 
with  the  SDA  director  and  the  different  program  operators,  you 
know,  "What  is  going  on  here,"  there  are  a  lot  of  measures  out 
there  as  to  how  things  are  going,  and  we  do  ask  tough  questions. 

A  good  example  of  this,  and  where  we  see  things  not  working, 
and  we  are  constantly  trying  to  make  things  better.  When  we  start- 
ed Maryland's  Tomorrow  Dropout  Prevention  Program,  after  the 
first  IV2  years  we  had  our  results  in.  Academics  for  the  ninth -grad- 
ers was  a  big,  big  problem. 

We  had  this  wonderful  summer  program  with  outward  bound 
and  work  experience.  And  we  said,  "Wait  a  minute.  We  got  to  get 
going  on  academics  so  when  they  come  in  the  ninth  grade  they 
really  have  a  running  start  instead  of  being  behind."  So  we  greatly 
reinu)rced  our  academic  enrichment  in  Maryland's  Tomorrow  Pro- 
-am and  improved  the  program  results.  We  are  constantly  tinker- 
ing, asking  tough  questions,  making  it  better. 

I  am  delighted  to  see  that  the  President's  proposal  for  summer 
challenge  talks  about  a  third  of  the  new  money  being  available  for 
academic  enrichment.  We  are  great  believers  that  summer  pro- 
grams should  have  a  very  strong  foundation  in  skill  training  and 
basic  skills,  and  helping  kids  get  through  school,  and  not  just  work 
experience. 


99 

Other  things  that  have  happened.  We  have  had  a  real  tough  time 
in  our  literacy  programs  in  terms  of  coordinating  across  all  the  dif- 
ferent things  going  on.  That  is  something  we  are  still  working  on, 
with  adult  basic  education  and  all  these  different  little  funding 
sources  kicking  around  out  there,  how  we  can  also  convene  literacy 
teams  at  the  local  level.  In  Baltimore  City  we  have  a  great  progpram 
going  that  way,  but  elsewhere  in  the  State,  a  problem.  The  job 
service  has  been  a  big  difficulty  in  years  past  in  terms  of  trying  to 
get  them  on  the  team. 

So  those  are  the  problems  that  we  continue  to  struggle  with, 
with  our  programs. 

In  terms  of  who  we  serve  in  Baltimore,  Baltimore,  like  many 
other  large  cities,  has  enormous  problems  with  desperately  poor 
people  and  lack  of  jobs.  Fifty-one  percent  of  the  people  in  our  pro- 
grams, JTPA  programs,  are  welfare  recipients.  Ninety  percent  are 
minority.  A  third  are  dropouts,  and  that  is  even  though  we  have 
a  lot  of  in-school  programming. 

As  I  mentioned  in  terms  of  people  served,  one  of  our  big  pushes 
now — and  I  think  the  JTPA  amendments  are  pushing  in  the  right 
way — is  out-of-school  youth,  because  we  are  losing  50  percent  of  the 
kids  entering  high  scnool  who  are  not  coming  out  the  oack  end.  We 
have  a  big  push  with  young  male  dropouts  that  we  are  just  starting 
now. 

Fifty-five  percent  of  the  young  African  American  men  in  Balti- 
more that  are  18  to  35  are  either  awaiting  trial,  in  prison,  or  on 
parole.  An  enormous  problem  that  is  literally  tearing  out  the  con- 
fidence and  spirit  of  Baltimore.  We  have  a  great  city  but,  unless 
we  do  something  about  helping  these  kids  get  into  society  in  a  pro- 
ductive way,  we  are  in  big  trouble. 

So  we  have  an  action  plan  that  we  are  putting  together.  The 
State  is  working  on  this  and  the  Baltimore  PIC  is  working  on  this, 
to  do  a  residential-based  program  for  first-time,  nonviolent  offend- 
ers, working  with  the  Job  Corps  as  a  possible  satellite  demonstra- 
tion project. 

We  want  to  do  a  skills  academy,  a  nontraditional  approach  to 
skills  training  outside  of  the  traditional  school  environment,  a  very 
disciplined  kind  of  base.  We  want  to  do  community  hubs  where  we 
can  put  the  same  kind  of  comprehensive  efforts  that  we  have  done 
with  welfare  recipients,  with  women,  who  have  different  kinds  of 
barriers  and  problems.  We  need  to  do  that  with  the  young  men  in 
terms  of  how  we  can  speak  the  language  and  get  them  involved 
with  training  and  going  someplace. 

Another  population  served  that  we  are  starting  to  work  on  is  cur- 
rent workers,  in  upgrading  skills  and  trying  to  create  a  high-per- 
formance work  force,  working  with  business  on  management  and 
management  training  and  upgrading.  W^e  have  a  program  called 
partnership  for  work  force  quality  where  we  do  50-50  splitting  of 
costs  with  business  to  do  skill  training  with  employees  that  are 
currently  working. 

Does  JTPA  work?  I  think,  if  you  have  a  locally  managed  pro- 
gram, 640  PIC's,  in  a  flexible  program,  you  are  bound  to  have  some 
that  are  great  and  some  that  are  not  so  great.  My  personal  feeling 
is  that,  on  balance,  you  have  some  fabulous  programs  out  there, 
and  the  trend  is  up  in  terms  of  doing  better. 
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The  important  issue  is  how  Congress,  how  Washington,  how  the 
States  can  help  reinforce  and  make  local  programs  better.  There  is 
always  room  for  improvement  in  terms  of  tne  kind  of  things  you 
were  talking  about,  the  constant  hitting  on  the  performance-based 
outcome  measures — **Where  are  we  weak;  where  do  we  have  to  im- 
prove that?" — and  asking  those  tough  questions. 

Like  with  the  literacy  program  I  mentioned,  you  still  have  pro- 
grams out  there  that  are  measured  in  quality  by  the  hours  of  seat 
time.  As  a  businessperson,  I  could  care  less  how  long  somebody  sits 
in  a  seat  learning  how  to  read.  What  I  want  to  know  is  whether 
they  learned  to  read.  Do  they  have  the  skills  to  work  and  work  at 
one  of  my  job  sites?  That  is  what  reallv  counts  in  terms  of  outcome. 

Another  concern  whether  JTPA  works  is  this  kind  of  partnership 
with  other  agencies.  There  is  a  lot  of  progress  in  terms  of  this 
broader  PIC  role  at  the  local  level,  and  at  the  State  level  in  terms 
of  the  work  force  investment  system. 

One  of  the  biggest  culprits  is  Congress,  and  Washington,  with  all 
this  stuff  that  comes  out  on  vocational  education  or  welfare,  what- 
ever, constantly  heading  off  in  different  directions.  You  have  a 
work  force  system  that  is  set  up.  You  have  a  partnership  set  up 
with  the  private  industry  councils.  Use  it.  Use  it  effectively.  Make 
us  accountable.  Make  us  responsible.  But  give  us  the  help  and  re- 
sources to  do  it.  Don't  make  our  problem  worse  by  sending  this 
stuff  off  in  50  directions.  That's  a  big  issue. 

A  big  issue  for  us  in  Baltimore  and  other  big  cities  is  a  lack  of 
jobs.  You  can  talk  all  you  want  about  placement  rates.  Jobs  is  the 
bottom  line.  That  is  the  outcome  they  are  all  after,  and  quality  jobs 
that  pay  a  living  wage  for  a  family. 

Baltimore  has  lost  12  percent  of  its  employment  base  in  2  years. 
Maybe  the  economy  is  recovering.  Maybe  not.  But  it  sure  as  hell 
is  not  recovering  in  the  city  of  Baltimore  and  it  is  not  recovering 
in  cities  like  us  around  the  country. 

We  need  to  do  something  to  target  economic  incentives,  to  create 
jobs  in  cities,  because  the  disparity  between  city  and  suburb— it  is 
happening  in  Baltimore,  it  is  happening  all  across  the  country — is 
just  growing  enormous.  Us  folks  on  the  PIC's  and  in  JTPA  cannot 
do  our  job  unless  there  are  jobs  out  there  to  be  training  and  put- 
ting unemployed  folks  into.  So  we  need  your  help  with  that. 

In  the  meantime,  we  need  community  service  employment.  If  we 
don't  have  the  private  sector  jobs  available,  let's  put  these  folks  to 
work  with  community  service  jobs.  There  are  tons  of  good,  produc- 
tive things  that  we  can  do  in  our  community.  We  nave  a  tight 
budget,  and  if  we  could  get  the  kind  of  public  service  job  support 
we  used  to  get  under  the  old  CETA  program,  we  could  really  go 
somewhere. 

The  last  issue  is  resources.  When  I  started  on  the  PIC  in  1978, 
we  had  $115  million  to  work  with  on  that  PIC.  I  like  to  think  we 
are  good  and  efficient  and  effective.  But  we  have  a  bigger  problem, 
we  have  a  higher  unemployment  rate,  we  have  more  long-term  un- 
employment, we  have  less  jobs  to  put  people  in — and  we  have  $28 
million  to  work  with  now. 
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Llhe  prepared  statement  of  Mr.  Struever  follows:] 
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Testlriony  Of  William  Struever 

To  The  Government  Operations  Subcomiralttee  on 
Employoent,  Housing  and  Aviation 

Good  Morning,  I  am  Bill  Strusver,  Ui9  President  of  Struever  Brothers,  Ecclee  and 
R.uso,  a  deveJopment  company  In  Baltlmor©.  For  \Ua  past  ten  y©?.rs  I  have  been 
actively  working  with  education,  employment  and  trelnlng  programs  In  both  Bal- 
timore City  and  tlie  Stat©  of  Maryland.  I  am  currently  a  member  of  the  Baltimore 
City  Privates  industry  counon  and  tho  Governor's  Work  Force  Investment  Board.  I 
was  the  P5C  Chair  for  rrany  years  and  currently  chair  the  Youth  Policy  Committee 
for  the  Sta-e  Board.  I  am  also  active  with  NAPIC  an  I  serve  on  their  board.  Even  with 
all  this  experience,  I  don't  consider  myself  an  expert  on  the  JTPA  rules  and 
regulations.  But  I  have  had  a  good  deal  of  experience  wHh  JTPA  and  other 
government  work  force  development  programs. 

I  appreciate  the  opportunity  to  talk  v/Ith  you  today  about  JTPA.  I  mt  to  address  the 
tssues  outlined  in  your  Invitation  letter. 

1.     Description  Of  The  Role  Of  A  PIC  In  JTPA  Decisions  and  Funding 

The  simple  response  to  this  Issue  would  be  to  recite  the  party  line  and  say  that  the 
PiC  makes  alt  JTPA  funding  and  program  <;'eclslons.  Having  been  Involved  with  a 
PIC  end  the  State  Council  for  some  ^me,  I  know  that  this  Is  not  accurate.  PIC 
Involvement  with  fun^ng  and  program  decisions  varies  from  PIC  to  PIC  and  can 
evGn  vary  as  the  Issues  chango.  I  think  fl  I?  fair  to  say  Uiat  generally  tl. are  are  three 
ba3;lc  categories  or  types  of  roles  thCit  P!Cs  have  assumed.  The  first  Is  th^  role  of 
"Board  of  Directors'  which  Is  very  sin* Jtar  to  a  corporate  board  of  directors.  A  PIC 
that  has  adopted  this  role  Is  generally  very  Independent,  mskes  alt  of  i;ie  n.ajor 
funding  and  programmatic  decisions  and  sets  the  overall  policy  and  direction  for 
the  total  program.  In  Maryland,  this  role  Is  often  associated  with  PiCs  that  have  been 
incorporated.  Three  or  four  of  the  twelve  PICs  In  Maryland  have  adopted  this  type 
of  role. 

The  second  type  of  PIC  role  I  see  in  Maryland  Is  the  PIC  as  a  strong  program  and 
policy  board.  This  role  Is  somewhat  different  ttian  that  of  the  "Board  of  Directors*. 
PICs  that  have  adopted  this  second  type  of  role  make  major  policy  and  funding 
decisions  In  concert  with  the  local  Reeled  officials  who  appointed  them.  In  other 
words,  this  second  role  represents  8  closer  partnership  of  government  and  busi- 
ness. The  majority  of  PICs  in  Maryland  have  taken  this  approach.  For  example,  in 
Baltimore,  Mayor  Kurt  L  8^moke  has  embraced  the  work  of  the  PiC  and  fuM 
elevated  the  position  of  the  SDA  administrator  to  cabinet  statue. 
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The  last  typo  of  PIC  role  -  and  I  tm  happy  to  rsport  that  R  1$  In  the  minority  in 
Maryh  .td  -  Is  the  PIC  as  an  advisory  group.  At  the  onset  of  JTPA,  this  was  the  role 
that  th9  majority  of  PICs  In  Maryland  played.  Over  time  this  type  of  PIC  has  been 
phased  out  as  local  elected  officials  and  staff  r  illzed  the  advantages  that  come 
with  sharing  the  authority  and  respomtlblllty  tor  work  force  development  with  the 
business  community. 

While  both  the  first  and  the  second  roles  described  can  be  effective,  i  beBeve  that 
the  second  role  provides  the  best  opportunity  for  effective  PIC  Input.  Before  I  move 
to  the  second  Issue,  I  would  like  to  share  with  you  some  Ideas  as  to  the  appropriate 
role  for  a  PIC  in  the  future.  It  may  surprise  you,  but  I  believe  that  none  of  these  roles 
will  be  effective  in  the  future.  While  the  first  two  may  be  fine  for  a  PIC  that  Is  simply 
focusing  on  JTPA,  simply  focusing  en  JTPA  will  not  enable  most  communities  to 
address  the  wor1<  force  investment  issues  that  confront  our  Nation.  For  the  past 
year  or  so,  the  State  of  l\/laryiand  has  been  developing  and  fostering  the  Idea  that 
the  PIC  needs  to  evolve  Into  a  local  work  force  Investment  board:  a  group  of 
business,  government,  education,  and  community  leaders  v/ho  come  together  to 
addross  the  woric  force  Issues  that  are  of  concern  to  the  entire  community.  This  Is 
not  to  say  the  PIC  becomes  the  control  board  for  all  resources,  quite  the  contrary. 
This  now  PIC  role  Is  to  act  as  a  facilitator  to  provide  a  focus  tor  the  appropriate  local 
leadcia  to  work  together  to  solve  Issues  of  mutual  concern.  In  this  role,  JTPA  Is 
simply  one  of  many  resource  streams  that  fall  under  the  oversight  of  the  PIC.  We 
are  moving  for^vard  bi  Maryland  with  this  concept.  In  Baltimore,  we  are  fortunate  to 
have  a  progressive  PiC  which  attempts  to  function  in  this  role  and  is  able  to  mairstaln 
the  regular  attendance  of  key  players  In  the  City  Including  the  Superintendent  of 
Education,  the  President  of  the  local  community  college,  the  President  of  the  local 
,  AFL'CIO  and  many  others.  Realizing  the  need  to  identify  the  Job  for  the  fuUire  and 
a  means  of  customizing  training  for  Jobs  for  tiiose  outside  of  the  mainstream  labor 
force,  our  PiC  is  facilitating  a  ooUdborattve  effort  with  a  host  of  entities  form  industry, 
education,  end  government  to  address  this  challenge.  Our  Initial  focus  is  on  the 
health  Industry.  Thte  has  already  led  to  the  creation  of  a  new  Ufe  Sciences  Training 
Center  In  partnership  YflXh  our  local  cc>nmunity  college.  Other  PICs  in  Maryland  are 
also  experimenting  with  serving  in  similar  roles.  I  took  the  liberty  of  providing  you 
wrtth  a  descrlptfon  of  the  Idea  which  ¥re  oaB  "The  Action  Planning  GuideDnes  For 
Local  Integrated  Work  Force  Investment  Systems*.  It  is  attached  to  my  written 
remarkt. 

2.     Examples  Of  Successful  JTPA  Programs 

Ffrst,  I  need  to  tell  you  that  I  am  the  eternal  optimist.  Therefore,  from  my  pertpecUve, 
Viere  Is  no  such  thing  as  a  less-than-sucoossful  program,  there  are  only  programs 
that  are  more  succesafUl  than  others,  I  have  seen  some  JTPA  efforts  that  didnt  work, 
but  in  almost  every  Instance  this  was  more  a  result  of  the  people  running  tte 
programs  than  In  the  overall  program  concept  Therefore,  I  tf ont  want  to  focus  on 
the  things  that  didnt  work,  I'd  rather  give  you  some  Insights  a$  to  the  things  I  have 
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•odn  that  do  worfc. 

Baltimore  has  a  long  tradition  of  operating  successful  work  force  Investment 
programs  on  a  very  large  scale.  Starting  years  ago  with  CETA  and  Marlon  Pines 
and  rIgiTt  through  today  with  Unda  Harris  and  JTPA,  BaKlmore  has  had  outstar>dlng 
government  leadership.  If  I  were  to  characterize  the  quelines  I  sea  In  the  Baltimore 
JTPA  programs  that  cause  them  to  be  better  than  other  programs  I  come  into 
contact  with,  those  qualities  would  be  IgMoiSblA  ^nd  a  tjoBstlc  approach.  In  the  City, 
the  JTPA  program  Is  used  to  forge  real  partnerships  and  to  help  coordinate  many 
other  efforts.  Let  me  site  some  speciftc  examples: 

•  Pro|ect  tndependenco 

Project  Independence  (Pi),  is  the  Federal  JOBS  program  In  the  City.  It  Is  a  wonderful 
sxampl^  of  using  a  team  approach  to  he'p  people  en  welfare  break  the  cyde  of 
dependency  and  move  off  welfare.  The  City  PIC  convenad  a  welfare  policy  board 
which  brought  together  locally  ail  the  Important  actors  to  ^isure  the  creation  of  an 
effective  and  responsive  delivery  system.  I  believe  that  it  Is  this  tyt>e  of  collaboration 
that  has  resulted  in  one  of  the  most  e  jgressive  welfare  to  work  strategies  In  tiie 
country.  A  strategy  that  has  broi  ght  together  the  local  employment  and  tr-  Ining, 
education  and  social  services  delivery  systems  in  a  truly  integrated  fashion.  By 
coupling  JTPA  funds  with  resources  from  numerous  other  federal,  state  and  local 
funding  streams,  we  have  been  able  to  provide  a  high  support,  iong^erm  training 
and  education  program  for  people  on  welfare  and  It  has  produced  good  results. 

9  The  City  That  Reads 

The  City  That  Reads  is  an  Initiative  to  coordinate  and  organize  adutt  literacy 
resources.  Rs  goal  Is  to  eli.nlnate  Illiteracy  In  Baltimore.  Again  the  JTPA  system  In 
the  City  has  been  a  central  part  of  this  effort.  The  SDA/PIC,  working  hand  In  hand 
with  the  nonprofit  agency  created  by  the  City  to  address  the  problem  of  aduH 
Illiteracy  set  up  special  programs  throughout  the  dty  to  Jointly  provide  services. 
Using  this  approach,  both  the  JTPA  system  and  the  adult  education  system  are  al^e 
to  help  more  people  and  to  provide  a  more  comprehensive  service  delivery  system. 

o  The  Futures  Program  (School  Drop  Out  Prevention) 

starting  with  ilA,  JTPA  8%  and  State  funds,  the  PIC/SDA,  with  the  help  of  ttie  school 
system,  has  built  an  extenshre  dropout  prevention  program  for  a  numbei^  of  the  City 
high  schools.  This  program  Is  administered  by  the  PiC/SDA  and  operated  In  the 
school  by  school  employees.  Baltimore,  as  Is  true  In  many  urt»an  areas,  has  a 
significant  school  dropout  problem.  The  Futures  effort  has  started  to  have  a  positive 
Impact  on  this  problem,  i  think  that  this  effort  is  a  great  model  of  how  J1FA  can  be 
used  effectively  as  a  change  agent  in  the  schools. 
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"n^ere  are  many  other  good  examples  of  JTPA  efforts  that  wfcrtc  For  example,  the 
Baltimore  PIC  and  It's  government  partner,  the  Office  of  Employment  Development 
wore  at  the  helm  of  the  creation  of  ttio  Baltimore  Commonwealth.  This  provides  a 
continuum  of  services  tor  In-school  youth  to  prepare  them  tor  the  fytyre.  These 
cervices  Include  such  things  as  community  service  clubs,  college  camps, 
workshops  on  careers  In  government  and  Industry,  student  ieei'vjrshlp  development 
activities,  launching  entrepreneurs  Into  acton  and  other  unique  acttvides. 

I  think  that  It  Is  importa  \  to  note  that  In  the  City  things  work  because  we  donM  look 
at  people  as  simply  fitting  Into  a  particular  "program  slot",  we  endeavor  to  assess 
each  person  and  to  work  with  that  person  to  find  out  what  they  both  want  and  need. 
Then,  depending  on  the  resources  and  networking  available,  we  try  to  help  that 
person  get  what  they  need  to  achieve  a  labor  market  i^oal  that  Is  suited  to  them. 
'fh!3  type  of  approach  means  that  you  need  and  use  c ■!  types  of  program  slots  lo 
their  best  advantage.  V.Tien  we  are  successful,  and  help  people,  it  Is  usually  because 
we  were  able  to  connect  with  that  person,  work  with  them  and  ensure  they  got  the 
services  and  support  needed  to  reach  their  goal.  When  we  fail,  It  I3  most  cften 
because  v;o  never  made  the  Initial  connection  wKh  the  person  or  we  Just  didn't  have 
the  resources  to  provide  the  services  needed. 

3.    State  Cooperation  In  Supporting  Programs  And  Providing  Technical 
Assistance 

The  State  of  Maryland  is  a  great  example  of  what  States  can  do  to  provide  leadership 
and  support  for  the  JTPA  system.  Many  of  the  programs  that  I  cited  as  examples 
of  successful  JTPA  efforts  In  the  City  of  Baltimore  were  n.ade  possible  by  State 
support  and  State  leadership.  Some  specffle  examples  of  the  State's  leadership 
role  are: 

•  The  Federal  JOBS  Program 

This  program,  which  we  call  Project  Independence,  was  designed  by  the  State  to 
*  be  a  partnership  effort,  in  Maryland  the  State  requires  the  PIC  to  form  a  k>cal  team 
that  Is  made  up  of  our  Welfare  Office  Director,  the  tocal  school  representative  and 
the  SDA.  This  team  Is  responsible  for  devetoping  the  operational  plan  for  how  aU 
the  Federal  JOBS  funds  will  be  spent.  The  State  then  allocates  these  funds  directly 
to  the  PIC.  This  was  done  so  that  the  welfare  employment  and  training  system  could 
build  upon  -  not  duplicate  -  the  existing  tocal  employment  and  tr^dnlng  system.  I 
think  that  we  may  be  the  only  State  that  Is  using  the  PICs  In  this  type  of  role.  And 
the  results  are  that  the  State  obtains  more  sendees  for  the  welfare  clients  than  they 
would  have  gotten  H  they  had  set  up  e  separate  system. 

e  The  Maryland's  Tomorrow  Dropout  Prevention  Program 

I  mentioned  the  Futures  Program  eariler,  Wdl,  Futures  Is  a  part  of  a  larger  State 
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effort  called  Maryland's  Tomorrow.  The  State  decided  that  It  needed  to  actively 
work  with  at-risk  high  school  students  to  try  to  lower  the  overall  dropout  rate,  it  also 
decided  that  the  best  way  to  deal  with  these  young  people  was  to  initiate  a  change 
in  the  way  the  schools  approached  this  problem.  This  was  done  by  using  the  PiCs 
as  the  change  agent  for  this  effort.  Using  JTPA  8%  funds  and  an  ever  increasing 
level  of  Slate  funds,  the  State  allocates  funds  to  the  PICs  to  work  directly  with  the 
spools  to  provide  enhanced  services  to  kids  who  are  In  danger  of  dropping  out. 
WM  the  day*to*day  operations  are  run  by  local  school  staff,  the  PIC  Is  responsible 
for  the  overall  coordination  and  administration  of  the  progr«fn. 

And  th9  State's  baddrship  rote  Is  not  simply  limited  to  developing  new  progrsm 
models.  They  also  provide  leadership  In  a  number  of  other  areas.  I  pre'^io .  sly 
mentioned  the  State  Initiative  to  foster  a  new  PIC  role  and  to  develop  a  toCvii  work 
forco  Investment  team  that  can  can  upon  all  the  local  resources  to  address  work 
force  Issues.  Stin  another  example  1$  my  own  committee's  work  for  the  State  Work 
Force  Board.  This  group  has  been  grappling  with  the  problem  of  young  African 
Asnerlcan  males  dropping  out  of  the  mainstream  society.  We  tiave  spent  consider- 
able tln:e  trying  to  get  a  handle  on  ttils  problem  and  design  a  comprehensWe 
approach  to  deal  with  It.  I  have  included  a  copy  of  the  report  we  produced  that  both 
describes  the  problem  and  cutllnes  a  comprehensive  strategy  to  deal  with  it  This 
\9  an  example  of  the  type  of  policy  paper  that  is  widely  disseminated  and  then 
foBowed  up  on  by  the  State,  who  work  with  the  local  players  to  implement  the 
recommendations. 

Still  another  example  of  State  support  Is  the  technical  assistance  capacity  they 
foster.  Beyond  doing  the  things  that  the  JTPA  law  requires  in  providing  technical 
assistance  to  SDAs,  the  State  has  provided  the  resources  and  support  for  the 
development  of  the  Maryland  Institute  for  Employment  and  Training  Professlonab. 
This  Is  a  staff  dev^opment  and  techr^cal  asslstf^nce  unit  that  Is  lndepend»itly 
operated  by  the  SOAs  using  several  State  funding  sources.  The  State  also  provides 
resources  and  support  for  both  the  PiCs  and  the  SDAs  to  maintain  professions 
associations  whteh  provide  a  peer  to  peer  technical  assistance  capacity. 

While  an  of  the  Maryland  PICs  may  not  always  agree  with  the  specifics  of  what  the 
State  does,  I  dont  think  any  of  them  wouM  fault  the  State  for  not  being  supportive 
and  endeavoring  to  provide  leadership.  They  are  an  active  partner  In  an  that  we  do 
at  the  local  level  and  provide  a  leadership  and  support  function  that  has  made  our 
efforts  much  more  successful. 

4.    A  Profile  Of  Tho  Population  The  PIC  Serves  And  TTie  Definition  of 
Success 

I  have  read  the  criticism  that  some  PtCs  only  take  the  best  people  so  that  Otey  can 
ensure  posithre  reeuKe.  I  cant  epeak  to  what  other  PICs  do  but  I  can  teQ  you  that  In 
Baltimore,  we  work  with  the  people  who  need  help.  The  participants  served  by  the 
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Baitlmoro  City  PIC  are  whot  I  would  call  very  "high  &  isk'  In  terms  of  living  In  poverty 
end  the  educatlonrl  and  skills  (deficiencies  that  tfiey  have.  The  overwhelming 
malorlty  of  the  people  we  enroll  desperately  need  education,  employment,  training 
and  support  services  In  order  to  Increase  thefr  labor  market  potential  so  that  they 
can  compete  In  the  labor  market  and  move  towards  self-sufficiency.  Let  me  provide 
you  with  some  specific  characteristics: 

•  Over  90%  of  the  people  we  enroll  are  mlnorHles; 

•  46%  were  single  parents; 

•  51  %  were  welfare  recipients; 

•  34%  were  school  dropouts. 

In  terms  of  measuring  program  success,  the  PIC  has  made  It  clear  that  the  ultlmaSe 
goal  Is  to  have  Individuals  get  a  job  that  win  enab!  3  tnam  to  become  self-sufficient. 
This  means  getting  Jobs  tor  participants  that  either  provide  a  good  starting  wage  or 
provide  the  opportunity  for  advancement.  It  please  me  to  report  that  even  though 
we  work  with  some  of  the  hardest  to  serve  groups  and  we  have  •  for  the  last  two 
years  -  had  a  tight  labor  market  and  a  declining  Job  base,  65%  of  the  JTPA 
participants  became  empfoyedl 

We  also  measure  our  performance  m  a  number  of  other  ways.  Using  the  JTPA 
National  Performance  System,  we  took  at  what  the  people  in  our  proems  earn 
over  time  and  how  many  stay  emptoyed  foitowing  the  end  of  program  participation. 
While  looking  at  the  number  of  people  we  help  get  Jobs  looks  at  performance  from 
a  quantity  perspective,  th^^e  measurements  provide  us  with  more  of  a  qualKy 
ovalLtation  of  our  efforts.  The  PiC  has  had  an  excellent  record  when  Judged  by  these 
National  standards.  It  has  made  or  exceeded  all  of  its  standards  for  every  year  that 
they  have  been  used  in  the  JTPA  system. 

The  PIC  also  recognizes  that  there  are  Interim  stops  on  the  road  to  self-sufficiency. 
For  youth,  the  attainment  of  employment  competencies  is  «i  Important  measure  of 
Interim  success.  This  type  of  outcome  is  atoo  measured  and  the  PIC  exceeded  tMt 
JTPA  performance  standard  by  over  20%  last  year.  Another  interim  measure  of 
success  for  adults  is  the  attainment  of  a  GED.  The  PIC  sponsored  programs  were 
responsible  for  34%  of  ail  the  QED  administered  In  Baltimore  City  last  year.  Thto 
shows  the  strong  commitment  the  PIC  has  to  long  term  solutions.  I  am  very 
confident  when  I  relate  to  you  that  In  Baltimore  City,  the  PiC  sets  some  high 
expectations  for  the  JTPA  program  and  for  all  the  years  I  have  been  associated  with 
It,  the  program  has  met  or  exceeded  our  expectations. 

5.    Recommendations  For  Improving  JTPA 

From  the  conunents  I  have  made,  by  now  you  reaOze  that  I  think  JTPA  In  Baltimore 
Is  pretty  good.  In  fact,  the  one  major  diange  I  would  recommend  would  not  even 
apply  to  JTPA  m  Baltimore  or  the  State  of  Maryland  because  the  State  and  the  City 
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are  already  trying  to  make  the  change.  That  change  would  be  to  pu!l  mor^  of  the 
work  force  Investment  programs  together  $o  that  they  thecoma  a  real,  httegrated 
work  force  Investment  system.  Through  live  of  stx  different  laws  that  you  have 
passed  over  the  years,  you  have  Ci'eated  at  least  tivo  different,  ma]or  work  force 
programs  (JOBS/JTPA/Job  ServIce/Voc.Ed/Voc.Rehab)  and  probably  thirty  or  more 
other,  smaller  programs.  Just  the  other  day  I  heard  that  the  Defense  Department 
was  starting  a  "Job  Corps'  typo  program  to  be  operated  at  mlllt.?9ry  bases  tiist  have 
extra  capacl^.  While  this  may  be  a  good  Idea,  none  of  these  programs  are  really 
required  to  do  anything  more  than  pay  Up  service  to  Integrating  their  services  with 
all  the  other  programs.  The  really  amazing  thing  Is  that  there  Is  a  huge  overlap  in 
the  people  served  by  aD  ttiese  different  programs  and  I  would  surmise  th^t  a  lot  of 
duplication  In  Information  taking,  assessment  and  employabinty  planning  also 
occurs.  I'm  not  advocatlny  that  all  of  these  programs  bo  lumped  together  as  one 
effort,  but  I  p.m  advocating  that  States  be  required  to  sort  through  hew  all  of  them 
work  and  to  develop  and  use  a  plan  that  will  make  senso  and  cut  down  on  overlap. 
If  we  cou!  I  do  this  we  also  could  provide  a  mere  seamless  service  delivery  system 
and  might  even  be  able  to  develop  the  holy  grail  of  the  work  force  investment  syst&m 
-the  "one-stop  shop". 

My  second  recom:  iiendatlon  Is  probably  one  you  don't  want  to  hear.  Leave  JTPA 
alone  for  a  couple  of  years.  It  Is  Just  now  It  aplementlng  the  ma]or  changes  you  made 
In  the  law  last  fall  and  It  will  be  some  time  before  we  see  the  full  Impact  ol  these 
changes.  JTPA  is  Just  about  at  the  stage  where  it  has  matured  as  a  program.  It  will 
sea  the  passing  of  Its  first  decade  later  this  year.  I  have  heard  of  discussions  that 
since  JTPA  was  started  under  a  Republican  administration  that  It  might  well  be 
terminated.  This  would  be  a  very  big  mistake.  JTPA  Isn't  perfect,  but  It  Is  effective 
In  most  areas  and  It  Is  tite  only  program  that  provides  a  real  opportunity  for  an 
effective  government  and  business  partnership.  Making  additional,  m^or  changes 
to  JTPA  at  this  time  would  not  bode  w^l  with  the  local  business  conimunRy  -  many 
of  them  are  still  (Appling  with  the  recent  amendments.  Ending  JTPA  would  send 
•  dear  message  to  the  business  community  tiiat  this  type  of  partnership  Is  not 
bnportant.  At  a  time  that  we  need  ag^ressh^e  business  and  government  paiinershipa 
to  effectively  deal  wfth  global  economic  competition,  ending  the  one  real  partner- 
ship program  would  be  a  huge  mistake. 

I  want  to  end  my  remarks  by  noting  that  JTPA  provided  the  opportunity  to  buld  a 
comprehenolve  system  to  serve  disadvantage  people.  In  Maryland  -  and  I  suspect 
the  same  Is  true  for  many  otiier  States  -«  we  bidlt  on  tills  opportunity  to  expand  and 
forge  tiie  beginnings  of  a  work  force  delivery  system  Oiat  encompasses  so  much 
more  than  simply  JTPA.  Drasticany  altering  or  ending  JTPA  could  well  tear  down 
this  Infrastructure  that  It  has  taken  years  to  bui'd.  I'm  In  the  business  of  taking  solM, 
okJ  buDdlngs  and  buDding  on  to  them  and  making  them  better.  I  knowthls  approach 
makes  sense.  I  would  strongly  recommend  mat  be  the  approach  the  Federal 
government  takes  when  K  considers  what  to  do  with  JTPA. 
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THE  ACTION  PLANNING  GUIDELINES  FOR  LOCAL 
INTEGRATED  WORK  FORCE  INVESTMENT  SYSTEMS 


I.      INTRODUCTION: 

America  is  In  a  period  of  economic  challenge  -  R  has  been  called  by  some  experts  an 
economic  war.  Our  success  In  responding  to  this  challenge  wiH  Impact  upon  every 
person  In  this  Nation.  With  the  close  of  the  Cold  V/ar  and  the  opening  of  new  markets 
throughout  the  world,  the  potential  for  a  productive  and  thriving  economy  based  upon 
export  expansion  has  never  been  greater.  If  we  are  able  to  capitalize  on  this  potential, 
our  Nation  will  thrive  and  continue  to  offer  opportunity  for  our  children  to  prosper  and 
maintain  our  standard  of  living.  If  we  cannot  compete,  it  directly  translates  Into  shrinking 
opportunity  for  our  young  people  and  to  an  erosion  of  our  living  standard  as  compared 
to  our  industrialized  competitors. 

While  we  won  the  Cold  War.  all  Indicators  point  to  the  stark  fact  tliat  we  are  losing  this 
economic  war  to  our  European  and  Asian  competltofs.  The  reasons  why  we  are  toslng 
are  complex,  but  every  expert  agrees  that  a  major  factor  -  perhaps  the  single  most 
Important  factor  --  Is  that  our  work  f  ^rce  Is  not  as  productive  and  skilled  as  our 
competitors.  Consequently,  It  Is  critical  that  we  solve  this  problem. 

The  Governor.  In  the  State's  Wori<  Force  Investment  Plan,  has  set  out  a  vision  to 
address  this  challenge.  The  vision  b  for  every  citizen  In  Maryland  to  have  the 
opportunity  to  fully  develop  the  skills  and  abiPrtles  needed  to  maximize  life-long 
eamlnge.  This  vision  kicludes  providing  Maryland  employers  with  a  highly  skilled, 
productive.  workJ  dass  Work  Force  Investment  System  that  maximizes  the  efforts  and 
resources  of  government,  education,  business,  and  the  community.  Achieving  this 
vision  requires  creating  a  Work  Force  Investment  System  with  the  specific  misston  of: 

•  Integrating  programs  and  resources  into  a  seamless  service 
delivery  system  that  Is  keyed  to  local  economic  development  .^ 
planning  and  Is  customer  driven,  provides  better  access  and 
produces  a  vfork  force  that  Is  world  class  and  capable  of 
competing  In  the  global  economy. 
The  Governor  and  his  caWnot  fully  support  the  forging  ot  sudi  a  system  In  Maryland. 
The  Departments  of  Human  Resources,  Economic  and  Employment  Development, 
Education  and  Higher  Education  ell  have  Joined  in  this  effort  and  are  pledged  to  actively 
work  as  a  team  to  both  create  a  State  Work  Force  Investment  System  and  to  foster  and 
support  k>cai  areas  to  do  the  same. 

A  prerequisite  tbr  creating  a  Wortt  Force  Investment  System  is  that  all  of  the  people 
responsible  for  the  existino  core  of  wor1<  force  Investment  progr3ir»  must  form  a 
working  team  that  Joins  wHh  the  private  sector  and  jointly  acts  to  address  our  vwMk 
force  problems.  The  State  has  such  a  planrdng  and  polcy  team  in  the  Cfovernor'a  Work 
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Force  Investment  Board  (GWIB).  These  Action  Planning  Guidelines  wiH  serve  to  assist 
local  areas  In  formally  accomplishing  the  same  -  bringing  people  who  are  responsible 
for  programs  together  with  representatives  of  the  private  sector  to  work  as  a  team  so 
that  they  can  forge  a  comprehensive  plan  and  a  comprehensive,  complementary 
service  system  for  achieving  work  force  Investment  goals.  "The  Stale  recognizes  that 
many  areas  may  already  have  comparable  teams  In  place.  This  Initiative  Is  not  Intended 
to  duplicate  existing  efforts  but  rathier  expand  their  role  and  function. 

The  planning  guidelines  that  follow  have  been  designed  to  serve  three  interrelated 
purposes: 

•  To  provide  the  parameters  and  focus  for  the  drafting  of  a  local 
integrated  Work  Force  Investment  Action  Plan; 

•  To  outline  a  process  fcr  local  areas  to  use  to  create  this  plan;  and 

•  To  establish,  at  the  local  level,  a  point  of  accountability  for  the 
work  force  Investment  system. 

il.     GOALS  AND  OBJECTIVES: 

A  critical  element  for  developing  a  Work  Force  Investment  System  Is  to  establish  a  clear 
focus.  Goals  and  objectives  serve  that  purpose,  Accordingly,  the  Governor  has 
established  two  broad  based  goals  (or  the  Work  Force  Investment  System.  Included 
vin'th  these  two  goals  are  four  focus  areas  that  represent  Important  State  issues. 

Goal:  The  Work  Force  Investment  System  will  work  to 

Increase  the  labor  market  attachment  and  labor 
market  value  of  all  Maryland  citizens. 

Goal:  The  Work  Force  Investment  System  will  Improve  the 

delivery  of  services,  and  make  them  more  effecthre, 
efficient,  accessible  and  responsive  to  the  needs  of 
both  employers  and  people  seeking  employment 

Challenge      Improve  School  Performance:  It  Is  firmly  believed  that 

Areas  1 :         if  we  can  Improve  student  competencies  while  In 
school  and  develop  a  rational  connecting  system 
between  school  and  work,  many  of  our  problems 
would  be  alleviated.  Local  areas  ere  urged  to  work 
creatively  to  de-mystIfy  the  workplace  for  schools  and 
de-mystify  schools  to  employers  so  that  better 
Interactions  can  develop.  Achievements  will  be 
measured  primarily  by  the  Maryland  School 
Performance  Program,  to  Include: 

•  Graduation  Rates; 

•  School  Performance;  and  In  8ddltk>n 

•  The  Development  of  Local  School  to  Work/EducaHon 
Transition  System. 
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2-  Improve  the  Welfare  to  Work  Trnniiltlftn;  Trying  to 

develop  a  quality  Project  Independence  program 
within  the  constraints  of  the  Family  Support  Act  Is  a 
continuing  challenge.  In  addition,  the  national 
climate  concerning  welfare  reform  will  be  undergoing 
dramatic  changes.  It  Is  hoped  that  new  resources, 
new  program  models,  more  employer  participation  In 
grant  dive  rslon,  on-the-job-tralning  (OJT),  -  work 
experiences  will  emerge  that  will  enhance  and 
accelerate  the  move  up  from  dependency. 
Achievements  will  be  measured  by  the  Increase  In  the 
number  of  welfare  recipients  that  are  placed  and 
retained  In  quality  Jobs. 

3.  Increase  Servlftfttt  For  Q^^\  pf  School  Yq^'^h;  The 

national  specter  of  millions  of  out  of  school  youth  - 
unemployed  -  alienated  •  and  actively  Involved  with 
only  one  system,  the  correctional  system  -  must 
change.  Schools  -  community  clubs  -  employers  - 
recreation  specialists  •  career  counselors  -  all  must 
play  creative  roles  In  bringing  young  people, 
particularly  young  males,  back  to  their  families  and 
their  communities  as  constructive  citizens  and 
workers.  Easier  said  than  done.  Achievements  will 
be  measured  by  realizing  an  Increase  In  the  numbers 
of  out  of  school  youth,  especially  out  of  school  young 
males,  that  are  actively  engaged  In  acth^IUes  to 
Increase  their  prospects  of  obtaining  and  maintaining 
economic  self-sufficiency. 

♦•  improve  Work  Force  Develonment  Strategiaa;  if  i« 

hoped  that  the  expertise  of  the  Career  and 
Technology  Educators,  the  Community  Colleges,  and 
the  JTPA  system  working  In  concert  v^rfth  local 
employers  will  be  able  to  better  articulate  skill 
standards  and  training  models  to  meet  local  labor 
market  needs  for  a  diverse  group  of  Job  seekers-  the 
chronically  unemployed,  the  displaced  worker  and     . 
the  new  Job  seeker.  Achlevemente  will  be  measured 
by  the  change  In  the  number  of  training,  retraining 
and  upgrading  actlvfUes  currently  taking  place  In  the 
Jurisdiction  for  adults  and  the  poslthre  outcomes  of 
those  activities. 

These  ooab  and  chtfteng©  areas  are  suggested  88  the  Btefting  polnta  for  locd 
planning.  It  Is  euggested  that  tocal  Teams  InWally  select  tv«  chaBengo  areas  for  Ihe 
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first  planning  phase.  The  other  focus  areas  can  be  addressed  in  a  later  plan 
modification.  The  local  team  should  consider  adding  additional  goals  and  challenge 
areas  as  needed  to  address  specific  labor  market  problems  In  their  Jurlsdictloa 

If  a  Planning  Team  believes  that  a  State  focus  area  has  been  adequately  addressed  In 
their  Jurisdiction  and  no  longer  presents  a  problem.  It  can  concentrate  the  planning 
effort  on  the  remaining  challenge  areas.  Furthermore.  If  the  local  team  believes  that 
another,  local  issue  Is  more  critical  than  a  State  focus  area  and  resources  do  not 
currently  exist  to  address  both  the  local  issue  and  the  State  challenge  areas.  It  may  opt 
to  substitute  the  local  Issue  for  one  of  the  State  challenge  areas  with  a  brief  explanation. 

ill.     RESOURCES: 

A  number  of  Federal.  State  and  local  resources  are  avaiiabte  that  can  potentially  be 
used  to  address  wor1<  force  Issues.  The  key  ones  are  Isted  below.  Programs  receiving 
funds  from  the  following  resource  streams  shoukJ  be  asked  to  partteipate  with  this  effort 

•  The  Job  Training  Partnership  Act  Funds; 

•  The  Wagner-Peyser  Act  (Base  Grant); 

•  Community  College  Funds  (Career  and  Continuing  Education 
Programs); 

0  State  and  Federal  Vocational  Technical  Education  Funds; 

•  JOBS  Funds; 

•  Maryland's  Tomorrow  Funds; 

•  State  and  Federal  Adult  Baste  Education  Funds. 

At  local  discretion,  other  programs  can  be  Included  sudi  as  Community  Development 
Block  Grants,  Health  and  Human  Services  funds.  HUD  resc  irces.  k)ca!  career 
education  funds,  vocational  rehabilitation,  state  and  \ocsl  economic  dev^opment 
resources. 

IV.  THE  PUNNING  TEAM: 

The  success  of  this  Important  effort  Is  conthigent  upon  the  existence  of  an  active 
planning  team  of  co-equal  partners,  each  bringing  different  resources  and  insights  to 
share  with  the  group  as  It  focuses  on  the  critical  work  force  Issues  that  face  the 
community.  In  order  to  avoid  unnecessary  duplication  and  to  build  upon  exlsl^ 
systems,  Private  Industry  Councfls.  are  being  asked  to  act  as  the  facffitators  of  this 
planning  process.  They  are  encouraged  to  take  this  opportunity  to  lead  the  way  to  a 
productive  and  Integrated  partnership  of  allthe  concerned  entitles  at  the  local  level  Bui 
the  GWIB  recognizes  that  some  Prfvate  Industry  Coundto  In  the  State  may  not  fW 
comfortable  with  assuming  such  an  enlarged  leadership  role.  Therefore,  eAer 
convening  the  Team  for  He  first  meeting,  If  the  PIC  deddes  not  to  take  on  the  leadership 
rote,  the  specific  roles  of  the  partteipating  groups,  akyig  with  the  Identificatfon  of  a  chair 
to  assume  the  leadership  role,  shoukJ  be  dedded  by  ihe  majority  of  the  team  mer riDecs. 
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The  planning  team  partners  should  Indude: 

•  The  PIC  Chair  or  a  PIC  Business  Member  (Planning  Team 
Convoner); 

©  The  Job  Service  Manager{s)  from  each  jurisdiction  represented; 

•  The  Presld8nt(8)  of  any  Community  College  In  the  area; 
d  The  SDA  Director; 

•  The  Social  Service  P!rector(8)  from  each  Jurisdiction 
represented; 

•  The  Superlntendent(8)  of  Schools  from  each  Jurisdiction 
represented. 

At  the  discretion  o(  the  person{s)  Identified,  designees  who  are  authorized  to  act  for 
the  team  member  can  be  named  to  the  Planning  Team.  Furthermore,  In 
multi-Jurlsdlctional  areas,  other  mambershlp  arrangements  may  be  considered  such  as 
Team  members  from  a  parUcuIar  agency  selecting  a  single  representative  to  actively 
participate  and  be  the  spokesperson  for  the  entire  group. 

It  Is  strongly  encouraged  that  the  team  scel<  to  Involve  other  employers,  perhaps 
Incorporating  employers  that  are  active  with  the  local  advisory  coundls  for  the  local 
areas'  technical  programs.  Furthermore,  the  Team  should  seek  Input  and  participation 
from  other  local  government  and  community  based  organizations,  and  from  tlie  not  for 
profit  sector  that  are  providing  work  force  servfees,  such  as  adult  education, 
correctional  education,  economto  devetopment,  vocational  rehabiTrtatton  seivtees 
health,  housing,  eta  * 

Staff  support  for  the  team  can  be  provided  by  any  or  aO  of  the  agerteies  partfcipating 
with  the  effort.  It  is  dear  thai  the  Tc  jm  wfll  rely  upon  good  staff  work  In  order  to  make 
this  endeavor  a  successful  one.  Because  of  the  critical  nature  staff  support  plays  In  this 
type  of  undertaking,  the  spedfic  plan  for  staffing  the  Team  must  be  a  mutually 
acceptable  arrangement  for  th©  majority  of  the  Team  members. 

The  State  hopes  to  provWe  a  capacity  bunding  planning  grant  of  $15,000  to  every  team 
(not  to  exceed  12)  which  can  be  used  for  staff  support.  Local  programs  are 
encouraged  to  supplement  and  support  these  funds  with  addMonai  cash  and  In-  Wnd 
resources. 

V.     PLAN  OUTLINE: 

The  following  outline  has  been  established  for  each  area  to  use  to  dev8k}p  a  plan. 
A.     Mission 

Each  plan  should  develop  a  statement  that  WentWes  the  over^archhg  mission  of  the 
total  Work  Force  Investment  System.  This  mbston  should  be  reftecBve  of  the  ooals 
end  objectives  stipulated  In  these  fluWeBnes.  ^^ 
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B.  Goals  and  Objectives 

The  challenge  areas  tdenti^ed  In  Section  II  and/or  any  local  challenge  araas  should 
be  listed  In  this  section  of  the  plan.  Please  note,  it  Is  critical  that  for  each  focus 
Issue,  clear,  measurable  outcomes  be  developed  so  they  can  be  used  for  local 
reporting  and  accountability. 

C.  The  Planning  Team 

A  brief  description  of  the  |:rfannlng  team  and  how  it  worlts  should  be  Included.  This 
section  should  Induds: 

•  T^o  names  and  organizational  afflllattons  of  all  the  team  members; 

•  A  brief  description  of  how  the  team  was  staffed;  and 

•  A  brief  description  of  the  team's  planned  actions  for  the  future,  Including 
how  oversight  of  plan  wlli  be  accomplished  in  the  upcoming  planning 
period. 

D.  Current  Effort 

This  section  of  the  plan  should  briefly  Identify  cun-ent  efforts  and  resources  that  are 
used  for  each  of  the  four  State  work  force  investment  challenge  areas  described  In 

Section  il  and  any  locel  fow§  yggs  ihst  are  being  selected.  Resources  should  be 
specifically  Identified  as  to  source  of  funds,  focus  area  and  projected  expenditure. 

E.  Planned  Improvements 

TTiis  section  should  identify  the  challenge  areas  that  have  been  selected  by  the 
local  planning  team  as  their  year  one  priority  areas  for  the  planning  cycle  (see 
Section  VI  -  Time  Frames).  A  brief  description  of  how  the  various  programs  and 
resources  v/IB  be  used  to  address  these  areas  should  be  provided.  Include  in  this 
description: 

•  M\e  overall  approach/)?lan  of  action 

•  Specified  allocation  of  resources/budget 

•  Outcomes  expected 

•  Collaboration  planned 

F.  Reporting  System 

TTie  key  to  a  successful,  ongoing  planning  process  Is  feedbad<  on  results.  TNa 
section  of  the  plan  should  detail  the  type  of  feedback  the  Plannkig  Team  hopes  to 
Institute.  Speciflcelly,  this  section  shouM  Identify; 

•  What  reports/data  will  be  required; 

•  How  wto  aucceaa  be  defined; 

•  What  ben(^  mark  period/data  wBI  be  used; 

•  Who  will  be  required  to  report; 

•  Ttie  frequency  of  reports;  end 

•  The  fonow-up  action  based  on  the  reports. 

Q.     Planning  Grant 

Briefly  describe  how  the  planning  grant  vi/as  or  wffl  be  used  by  the  k>cal  team.  This 
grant  has  been  provided  to  feclltate  the  development  of  the  plan  and/or  to  facHtate 
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the  ongoing  planning  and  monitoring  process.  The  funds  can  also  be  used  to  foster 
Bnkages  and/or  Interagency  cooperation.  Include  In  this  description  the  time  frames 
for  expenditure  and  the  what  specincally  will  be  purchased  with  the  funds. 

H.     Program  Agreements  (Optional  Section) 

It  may  be  helpful  and  productive  for  agencies  to  formulate  agreements  to  outline 
coflaboratlvQ  operations  and  Integrated  activities.  K  agreements  are  being 
developed,  provide  a  brief  description  of  which  agencies  and  the  focus  of  the 
agreenrtent  (or  attach  a  copy). 

i.      Concurrence 

All  major  Team  memt>6rs  Involved  should  show  their  conoirrence  with  the  plan  t>y 
signing-off  on  the  plan. 

VI.   TIMEFRAMES: 

The  first  planning  cycle  wiO  be  three  years  and  the  time  frame  covered  by  the  plan  will 
be  1/1/94  to  12/31/96.  Critlca]  dates  for  the  current  planning  cycle  are: 

9  Publication  of  final  planning  guidelines  by  the  State  -  6/1/93; 

•  Submission  of  Phase  1  plan  to  State  -- 11/30/93; 

o  Comments  from  the  State  on  the  local  plan  - 12/30/93; 

•  Submission  of  Phase  2  plan  to  State  >  6/30/95; 


118 


TEL:  Rpr   28,93   12:03  No. 005  P. 18 

Questions  About  tSie  Intogra^ed  Plan 

Process 

1.  Why  Is  an  Integrated  plan  needed? 

Many  of  the  unsolved  work  force  Investment  Issues  cut  aaoss  the  boundaries  of  State 
and  local  agencies.  No  one  agency  has  all  the  resources  and  expertise  needed  to 
adequately  address  these  cross  cutting  Issues.  An  Integrated  plan  Is  the  best  way  to 
effectively  begin  the  process  of  dealing  with  these  Issues.  Furthermore,  the  private 
sector  has  not  tradRtonally  taken  an  active  rote  In  planning  for  or  addressing  hurnan 
resource  development  Issues.  Since  they  are  ultimatety  expected  to  provide  jobs  for 
the  people  that  take  part  in  these  human  resource  development  Initiatives,  they  need  a 
way  to  be  actively  Involved.  The  development  of  an  integrated  planning  process  and 
approach  provides  such  a  mechanism, 

2.  With  all  the  changes  ebout  to  take  place,  why  start  an  Integrated 
planning  process  now? 

To  paraphrase  a  former  President  who  paraphrased  a  former  Chinese  philosopher,  *A 
Journey  of  a  thousand  miles  begins  with  one  step".  We  have  a  very  long  way  to  go  to 
address  the  critical  workforce  Investment  Issues  that  confront  ua.  We  cannot  afford  to 
wait.  It  Is  true  that  many  of  the  programs  that  will  come  under  this  process  face  a  future 
that  will  be  characterized  by  change.  The  type  of  joint  planning  and  interaction 
envisioned  to  be  a  part  of  the  integrated  planning  process  should  In  every  Instance 
assist  these  agencies  and  programs  better  respond  to  the  changes  they  may  be  asked 
to  make.  An  example  of  this  Is  the  current  JTPA  system.  The  recent  amendments  to 
the  Federal  law  require  a  number  of  specific  linkages  and  coordinated  efforts  that  are 
very  much  In  line  with  the  scop©  and  purpose  of  the  Integrated  planing  effort 

3.  What  do  I,  as  the  head  of  one  of  the  participating  organizations, 
stand  to  gain  by  participating  wKh  this  effort? 

The  way  the  Wegrated  planning  process  has  been  outlined,  participating  organlzatlone 
stand  to  gain  a  great  deal  and  risk  very  little  by  participating  with  this  effort.  Qh/en  the 
assumption  that  the  chaBenge  areas  selected  by  the  State  (or  those  that  will  be 
selected  by  the  Team)  represent  critical  communfty  Issues,  the  team  provides  the 
agency  head  with  an  opportunity  to  Impact  on  the  utilization  of  other  resource  streams 
that  exist  In  the  communiity  that  could  bo  used  to  address  these  Issues.  For  agency 
leadera  that  have  the  responslbltlty  for  Improving  the  Uvea  and  quality  of  life  in  the 
community  this  is  an  opportunity  that  seWom  presents  itself.  Furthermore,  the  ablOty  to 
work  direoUy  with  other  deciskjn  makers  In  the  comrrxinlty  and  share  expertise  and 
resources  to  forge  a  collaborative  approach  to  address  these  issues  shouki  be  an 
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exiiliaratlng  experience. 

4.  Does  the  State  plan  to  use  the  integrated  Plan  as  a  control 
document? 

While  the  State  will  review  the  plan,  it  Is  not  a  State  control  document.  It  Is  envisioned 
that  the  loca!  team  will  use  the  plan  end  the  process  estabfished  tocally  to  monitor  Its 
Imptemantatton  as  an  accountabiSty  tool,  but  the  State  win  not.  It  is  anticipated  that  the 
plan  narrative  submitted  to  the  State  Annually  will  Include  a  brief  summary  of  the 
(Togress  made.  It  Is  not  planned  that  any  formal  reports  win  be  required  by  the  State 
relative  to  the  pianned  activities. 

5.  Does  the  plan  require  the  team  to  establish  a  new  and/or  an 
addKional  reporting  system? 

Nol  The  plan  guidelines  do  encourage  the  team  to  establish  an  accountability  process 
that  Includes  a  feedback  mechanism  and  reports.   But  this  system  does  not  need  to  be 
a  new  one.  At  local  option,  existing  reporting  systems  can  be  used  or  modified  to  fit  the 
needs  of  the  team. 

6.  if  the  PIC  Chair  leads  the  teitm,  does  that  mean  the  PIC  staff  must 
provide  the  start  support  for  the  team? 

TWs  is  a  local  decision.  The  State  fully  realizes  the  critical  need  for  adequate  staff 
support  for  this  effort.  Unfortunately,  adequate  resource  do  not  currently  exists  to 
provide  each  area  with  the  resources  needed  to  undenwrUe  appropriate  staff  support.  It 
Is  hoped  that  aB  the  organizations  involved  will  contribute  to  provide  the  staff  support 
needed  to  make  this  effort  work.  Another  approach  could  be  for  one  organization  to 
take  on  the  lead  role  for  staff  support  for  a  one  or  two  year  period  and  tf^n  pass  this 
responsibility  on  to  another  organization  that  Is  a  part  of  the  Team. 

7.  Is  this  Team'  Just  the  PIC?  If  not,  how  is  It  different  from  the  PIC? 

No.  the  Team  is  not  the  PIC.  This  is  not  to  say  that  the  PIC.  If  all  players  agreed, 
cannot  serve  as  the  TeamI  Sound  confusing,  let  us  explain.  From  Federal  legislative 
perspective,  participation  on  the  PIC  has  a  very  dfferent  focus.  PIC  members  come 
together  primarily  to  talk  about  and  to  specifteafly  decide  how  to  utntze  JTPA  resources 
and  the  other  resources  the  State  has  opted  to  channel  through  the  PlCs.  TTie  Team, 
while  H  may  In  many  Instances  be  the  same  people,  are  decision  makers,  coming 
together  to  talk  about  overarching  issues  and  to  try  to  map  out  a 
interagency/tntergovernmental  approaches  fbr  dealing  with  these  Issues.  These 
approaches  should  take  into  account  an  resources  streams  that  can  be  used  to  ded 
wMi  the  Issue. 
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That  distinction  made,  If  the  members  on  the  Team  believe  that  using  the  entire  PIC  as 
the  Team  Is  a  productive  way  to  develop  and  monitor  an  Integrated  plan,  they  can 
certainly  proceed  In  that  fashion. 

8.  Is  the  planning  team  being  set-up  to  determine  how  all  the  dollars 
are  to  be  spent  In  the  resource  streams  In  the  plan? 

Not  The  planning  team  should  be  viewed  as  a  partnership  group  ooming  together  to 
focus  on  specific  c*iallengs  areas.  Each  of  the  partners  is  a  "general  partner"  that 
brinfl'5  to  the  team  particular  resources  arxl  expertise.  The  team,  as  a  group  win  work 
to  get  a  handle  on  and  address  some  very  difficult  State  and  local  issues.  Hopefuly. 
each  team  member  wlB  participate  In  mapping  out  these  approaches  and  be  able  to 
materially  help  the  effort.  But  clearly,  this  may  not  always  be  feasible.  In  the  final 
analysis.  It  win  be  up  to  each  team  member  to  determine  the  effective  way  to  assist  with 
the  whole  team  effort. 

9.  What  happens  If  the  Team  maps  out  an  approach,  but  one  Team 
member  refuses  to  cooperate?  Can  the  Team  make  that 
organization  cooperate? 

T^e  team  (as  defined  as  the  primary  group  of  organizations  listed  In  the  planning 
guidelines)  Is  a  group  of  equals  with  each  team  member  exercising  unllatera]  control 
over  the  resources  that  they  are  legally  responsible  for.  if  an  approach  has  been 
mapped  out,  and  one  team  member  has  decided  that  their  organization  cannot  play  the 
role  outlined  for  them,  there  Is  no  legal  power  the  team  has  to  change  that  decision. 
This  is  why  It  is  critical  for  the  team  to  jointly  woi1<  together  to  develop  approaches.  R  Is 
difficult  to  envision  a  scenario  where  all  team  members  jointly  develop  an  approach  and 
then  after  It  has  been  agreed  to.  a  specific  member  refusing  to  follow  through.  After  al, 
the  Team  focus  on  cross  cutting  Issues  that  the  team  will  be  focusing  upon.  Issues  that 
en  the  Team  members  have  a  stake  In  addressing. 

10.  Will  the  State  make  the  organizations  It  funds  cooperate? 

The  State  has  a  funding  relationship  with  al  of  the  Team  members  (as  defined  In  tfie 
planning  guidelines).  Essentially,  two  different  funcSng  relationships  e»dst.  One  Is  a 
direct  relationship,  where  the  Team  member  Is  actually  a  State  employee,  and  the  other 
Is  a  contractual  or  grant  relationship  where  the  State  channels  funds  to  a  partk^iiar 
organization.  In  both  Instances,  The  State  plans  to  aggressively  encourage  team 
members  to  actively  participate  witii  this  eflbrt 

The  State  Intends  to  provkJe  As  enployees  with  a  measure  of  flexlblity  to  respond  to 
ttie  team  process  and  stands  ready  to  offer  Its  employees  technteal  assistance  In 
poatively  responding  to  Weas  and  approaches  tiiat  devetop  from  the  team  Interacfloa 
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But  In  no  Instance  does  the  State  intend  to  'strong  arm'  either  its  staff  or  the 
organizations  to  v/hlch  ft  channels  funijs.  Thte  would  litinnately  be  counter  producfivo  to 
the  building  of  effective  local  relationships. 

1 1 .  Does  the  team  need  to  address  the  four  challenge  areas  Identified 
in  the  planning  guidelines? 

The  challenge  areas  Identified  In  the  planning  guidelines  represent  critical  "people 
problems'  that  the  State  Is  trying  to  address.  Obviously,  it  these  are  critical  State 
•people  problems',  they  are  local  area  "people  pnjblems"  as  well.  Therefore,  in  most 
Instances,  the  challenge  areas  Identified  In  the  planning  guidelines  wlH  be  chalenge 
areas  that  exist  in  local  areas  too.  If.  In  the  opinion  of  the  majority  of  members  on  the 
team,  one  or  more  of  the  challenge  areas  identified  in  the  plannhg  guidelines  has  been 
or  Is  being  adequately  addressed,  the  Team  need  not  spend  time  planning  for  this 
(^llenge  area.  Ail  that  Is  requested  Is  that  the  Team  provide  a  bijk  statement  outlnlng 
why  tfiat  particular  challenge  area  Is  not  a  problem  in  their  area. 

12.  Can  Teants  pick  other  challenge  areas? 

Yes,  the  team  can  and  Is  encouraged  to  select  additional  challenge  areas  that  are 
believed  to  be  Important  work  force  Investment  Issues  that  need  to  be  resolved. 

1 3.  How  will  the  State  support  this  Initiative? 

The  State  plans  to  support  this  Initiative  In  a  number  of  ways.  Rrst,  once  the  planning 
guidelines  are  issued,  a  planning  conference  wflii  be  held.  The  purpose  for  the 
conference  will  be  to  bring  prospective  team  members  together,  to  outTine  the 
Qulddlines  e^d  to  start  the  planning  process.  Secondly,  the  State  currently  plans  to 
provide  a  $J5.000  planning  support  grant  to  each  area  to  provide  a  minimum  level  of 
resources  the  Team  can  use  to  facilitate  the  plan  development  and/or  monitoring 
process.  Lastly,  the  State  wOl  provide  ongoing  technical  assistance  to  help  local  teams 
In  this  endeavor. 

1 4.  Is  this  a  one  shot  deal? 

Hopefully  noti  The  need  for  our  State  to  develop  a  world  dass  work  force,  one  that  is 
capable  of  successfully  functioning  In  a  high  perfonnance  worl<  environment  is  not  a 
one  shot  problem.  It  will  tel<e  time  and  continued  effort  to  achieve  and  maintain  such  a 
wortt  force.  An  integrated  local  ptarving  and  accountability  process  is  a  step  that  wO 
help  us  achieve  this  goal.  Therefbre.  it  is  a  process,  that  is  successful,  should  continue 
to  be  used  to  respond  to  cross  culling  work  force  investment  issues. 

15.  What  happens  If  we  decide  not  to  establish  a  team  and  to  develop 
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a  local  Integrated  plan? 

In  a  few  words,  nothing  will  happen!  No  formal  team  will  bo  put  In  place.  No  Integrated 
planning  will  take  place.  And  In  all  probability,  little  in  the  way  of  comprehensive,  unified 
actions  wOl  occur  to  address  the  significant  work  force  Issues  that  confront  us.  In  short, 
the  community  loses  an  opportunity  to  address  some  very  Important  Issues  and  an 
opportunity  to  forgo  a  formal  working  relationship  with  the  leaders  In  the  cx)mmunlty 
that  determine  how  human  resources  issues  are  addressed.  Furthermore,  you  lose 
time  In  movltig  towards  a  more  effective  and  efficient  way  of  doing  the  business  of 
human  resource  development 

16. Who  do  i  call  for  additfonal  Information  or  If  I  have  questions? 

Call  Jim  CaRaJian.  the  number  Is  410-333-5606. 
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Mr.  Peterson.  Thank  you.  Thank  you,  Mr.  Struever.  Ms.  Irving. 

STATEMENT  OF  PATRICIA  E.  ERVING,  PRESIDENT  AND  CEO, 
PRIVATE  INDUSTRY  COUNCIL  OF  PHILADELPHIA,  PHILA- 
DELPHIA, PA 

Ms.  Irving.  Thank  you.  Good  morning,  Mr.  Chairman  and  mem- 
bers of  the  subcommittee.  I  am  Patricia  Irving,  president  and  CEO 
of  the  PIC  of  Philadelphia.  I  am  glad  that  you  have  given  me  the 
opportunity  to  tell  you  how  effectively  the  Job  Training  Partnership 
Act  functions  at  the  local  level. 

On  June  6,  1990,  the  board  of  directors  of  the  PIC  unanimously 
approved  a  new  mission  statement.  In  accordance  with  the  Job 
Training  Partnership  Act  and  the  Job  Opportunities  and  Basic 
Skills  Program,  the  Philadelphia  PIC  was  given  clear  direction  by 
the  board  to  transition  'Tiarder-  to-serve"  clients  from  dependency 
to  self-sufficiency.  To  accomplish  that  goal,  the  organization  made 
a  major  shift  from  an  employer-focused  program  to  a  client-focused/ 
employer-driven  system. 

In  short,  we  are  now  utilizing  a  sequential  training  process,  or 
a  three-tier  structure  to  effectively  train  clients  with  multiple  bar- 
riers to  employment. 

Realizing  that  the  PIC  had  and  has  sufficient  funds  to  serve  less 
than  5  percent  of  the  community  that  needs  us  and  that  com- 
prehensive programs  for  harder  to  serve  clients  are  more  expensive 
to  operate,  we  decided  to  leverage  our  funds  and  services  whenever 
and  wherever  feasible  to  offset  the  increased  costs. 

We  began  the  leveraging  process  by  successfully  integrating  our 
Job  Training  Partnership  Act  and  our  iob  opportunities  and  basic 
skills  programs.  Since  both  programs  nave  compatible  goals  and 
outcomes,  we  integrated  them  into  one.  We  reduced,  if  not  elimi- 
nated, duplicate  administrative  costs. 

We  have  enclosed  a  progress  report.  Our  theme  is  partnership — 
and  I  see  Mr.  Machtley  is  reading  it — so  that  is  what  we  are  all 
about — creating  partnerships. 

Our  approach  to  training  and  employment  is  very  basic.  We  only 
fund  training  programs  in  occupations  where  jobs  exist.  We  specifi- 
cally seek  placements  in  positions  that  pay  substantially  more  but 
never  less  than  $6  per  hour  plus  fringe  benefits. 

The  training  process  begins  with  outreach  and  recruitment.  We 
have  six  PIC  referral  centers,  19  county  assistance  offices,  and 
seven  job  centers. 

All  applicants  are  referred  to  the  "Fortune  Center"  for  initial  as- 
sessment, and  we  use  a  computerized  battery  of  tests  to  measure 
each  applicant's  basic  skills,  interests,  and  aptitude. 

We  serve  long-term  welfare  recipients;  transitional  needy;  long- 
term  unemployed/disadvantaged  adults;  homeless  men,  women, 
and  children;  drug  offenders;  ex-offenders;  high  school  dropouts; 
teen  parents;  at-risk  youth — in  and  out  of  school,  older  workers, 
and  dislocated  workers.  We  have  a  large  population  to  work  with. 

Just  to  mention  some  of  the  client  profiles  and  common  denomi- 
nators, I  would  just  like  to  say  that  most  of  our  clients,  including 
dislocated  workers,  lack  self-esteem  and  self-confidence.  Most  of 
our  clients,   including  dislocated   workers,  are   deficient  in   basic 
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skills — -job  skills,  interpersonal  skills,  and  critical  thinking  skills.  A 
significant  number  of  them  need  high  school  diplomas  or  GEDs. 

welfare  recipients  with  children  will  not  leave  welfare  for  mini- 
mum-wage jobs  and  no  benefits.  Dislocated  workers  who  have  been 
laid  off  from  low-skilled,  high-paying  jobs  need  extensive  training 
for  occupations  that  pay  considerably  less,  which  is  often  a  difficult 
adjustment  for  them. 

The  assessment  outcomes  determine  at  what  point  the  client  en- 
ters our  system.  We  use  a  sequential  training  process  as  follows: 

The  phase  I,  which  is  the  easiest,  is  training  readiness.  That  is 
where  we  thoroughly  assess  the  most  difficult- to-serve  clients,  £md 
we  provide  immediate  activity  to  increase  motivation. 

The  second  phase  is  a  feeder  program.  Our  clients  who  are  leav- 
ing the  first  phase  can  either  go  into  a  feeder  or  into  phase  III,  job 
specific  skills  training  programs. 

I  think  in  your  packet  I  tried  to  include  a  client  flow  chart.  I 
have  one  on  the  floor  which  is  big  and  pretty,  but  I  think  it  would 
take  too  long,  so  I  am  going  to  ask  you  to  make  reference  to  that. 
Because  of  the  time,  I'm  trying  to  move  through  this  process. 

All  of  our  programs  are  extremely  comprehensive  because  v/e  are 
looking  at  the  client  from  a  holistic  perspective,  and  we  think  it 
works,  and  it  works  very  effectively.  We  want  to  see  them  once.  We 
want  to  give  them  the  tools  for  life. 

Our  method  of  instruction:  We  used  competency  based  instruc- 
tion to  measure  and  monitor  the  client's  progress  throughout  the 
program.  This  kind  of  positive  feedback  also  builds  self-esteem  and 
sel^confidence. 

We  monitor  programs  programmatically  and  fiscally  on  a  month- 
ly basis  according  to  the  terms  and  conditions  of  the  contract. 
When  problems  are  identified  that  require  immediate  attention,  we 
remain  involved  until  the  situation  is  corrected. 

The  statistical  data  that  I  will  share  with  you  is  based  on  an  $8.6 
million  budget.  We  served  2,433  people,  67  percent  black,  18.5  per- 
cent white,  8.6  Hispanic.  Eighty-eight  percent  of  our  clients  lacked 
a  significant  work  history;  62  percent  were  receiving  public  assist- 
ance; 25  percent  were  high  school  dropouts;  37  percent  were  read- 
ing below  seventh  grade  levels. 

Our  average  cost  per  enrollment  is  $3,555 — quite  a  difference 
from  $10,000,  which  I  think  I  heard  someone  mention  earlier.  So 
there  is  a  way  of  leveraging  your  dollars  and  being  very  cost  effi- 
cient and  cost  effective. 

In  terms  of  Federal  and  State  performance  standards,  for  2  con- 
secutive years  we  have  met  all  but  one.  The  last  year,  the  entered 
employment  rate  for  dislocated  workers,  we  missed  by  a  hair  be- 
cause when  Congress  voted  the  UI  extension  benefits,  our  clients 
decided  not  to  go  to  work.  They  didn't  want  to  accept  employment. 

Like  my  colleague  to  my  lefl  says,  we  are  facing  a  very  tight  job 
market  with  mass  layoffs  and  plant  closings  in  the  city  and  sur- 
rounding counties.  As  a  result  of  that,  we  instituted  a  new  PIC 
business  partnership,  which  we  call  the  business  advisory  council 
[BAG].  They  are  composed  of  14  major  corporations  who  provide 
technical  assistance  to  us. 

We  did  not  say  to  them  [BAG]  that  we  had  all  the  wonderful 
qualified  people.  We  wanted  to  understand  the  shifts  and  changes 
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in  the  job  market.  They  have  made  many  recommendations  to  us, 
but  I  would  like  to  just  point  out  one  that  I  think  is  the  most  sig- 
nificant to  the  Philadelphia  Private  Industry  Council. 

It  was  strongly  suggested  by  the  BAG  that  we  develop  a  central- 
ized job  development  unit,  a  concept  of  one-stop  shopping  for  em- 
ployers, to  motivate  them  to  become  much  more  involved.  From 
their  standpoint,  it  would  reduce  recruitment  and  training  costs  as 
long  as  our  training  programs  are  producing  qualified  applicants. 
Then  there  would  be  a  very  good  match. 

As  a  result  of  the  PIC-business  partnership,  we  are  in  the  proc- 
ess of  establishing  the  centralized  job  development  unit  and  we  ex- 
pect it  to  be  fully  operational  by  July  1993. 

What  works:  This  is  what  we  think  works. 

Apprenticeship  models  of  training — theory  and  hands-on  experi- 
ence— are  the  most  effective  methods  of  training  the  harder-to- 
serve  adult  and  youth  populations.  Unfortunately,  these  programs 
are  generally  the  most  expensive.  However,  all  program  designs 
should  be  comprehensive,  holistic,  and  capable  of  removing  social 
barriers  to  employment  while  cultivating  job-specific  skills  that 
lead  to  permanent  emplojrment. 

An  indepth  assessment  of  the  individual's  basic  skills,  interests, 
and  aptitude  is  critical  to  the  process  of  matching  the  client  with 
the  most  appropriate  training  activity. 

Employer  involvement  in  programs,  particularly  the  curriculum 
design,  instruction,  and  the  use  of  internships  is  absolutely  nec- 
essary, because  employers  are  the  ultimate  customers  of  our  prod- 
ucts— the  trained  workers. 

What  doesn't  work:  Quick-fix  solutions — short-term  training — do 
not  produce  durable  outcomes  for  the  harder-to-serve  clients. 

Single-focused  programs  or  stand-alone  activities  do  not  work 
and  are  not  cost-effective. 

Ensuring  the  effectiveness  of  our  programs:  We  do  it  in  several 
ways,  which  I  really  want  to  concentrate  on. 

First,  we  start  off  with  a  competitive  RFP  or  request  for  proposal 
process.  Our  proposers  are  guided  in  the  design  of  comprehensive 
training  programs  by  making  certain  that  specific  components  are 
adequately  addressed,  namely:  Remediation,  life  skills,  job  develop- 
ment. Proposals  that  do  not  meet  our  guidelines  are  not  accepted. 

Second,  proposals  are  not  only  analyzed  by  the  operations  staff, 
but  they  are  also  preaudited  by  the  finance  department  to  ascer- 
tain the  reasonableness  of  costs. 

Third,  all  training  programs  are  then  reviewed  by  the  PIC's  pro- 
gram evaluation  committee  [PEC],  which  is  a  subcommittee  of  the 
PIC's  board,  comprised  of  seven  members  from  the  private  sector 
in  the  human  resources  areas.  The  PEC  is  responsible  for  the  over- 
all evaluation  and  selection  of  programs  and  makes  funding  rec- 
ommendations to  the  PIC's  board  of  directors  for  final  approval. 

Fourth,  contracts  or  legally  binding  documents  between  the  PIC 
and  its  subcontractors  must  be  fair  and  equitable,  with  terms,  con- 
ditions, and  performance  criteria  clearly  defined  and  legally  en- 
forceable. 

Fifth,  and  of  course,  I  have  mentioned  before,  briefly,  the  exter- 
nal and  internal  monitoring  process. 
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The  recommendations  to  improve  the  effectiveness  of  JTPA:  I 
come  at  this  from  a  different  angle,  only  because  we  have  so  many 
partnerships.  I  think  that,  at  tne  local  level,  we  become  awfully 
frustrated,  simply  because  different  funding  streams  don't  seem  to 
talk  to  each  other  or  work  with  each  other  very  effectively. 

If  I  had  a  wish  list,  I  would  wish  that  all  Federal  agencies  be- 
come a  little  bit  more  consistent  in  their  regulations,  definitions, 
income  eligibility  criteria,  MIS  data.  I'll  give  you  an  example  of 
what  I  am  talking  about. 

A  welfare  recipient  who  is  receiving  income  through  HHS,  living 
in  subsidized  housing — [HUD] — who  attends  PIC  training  pro- 
grams— Labor — is  screened  by  three  federally  funded  agencies,  has 
three  sets  of  paperwork,  three  sets  of  files,  documentation,  reports. 

Work  experience  wages  received  by  the  client  while  in  a  [JTPA] 
training  program,  could  cause  a  reduction  in  her  welfare  benefits 
and  an  increase  in  her  rent.  It  just  seems  that  altogether  the  sys- 
tem is  very,  very  counterproductive.  It  makes  our  jobs,  at  the  local 
level  a  lot  more  difficult. 

While  we  do  strongly  advocate  the  passage  of  the  amendments, 
we  only  wish  that  the  allocation  formula  had  taken  into  consider- 
ation the  number  of  disadvantaged  people  that  the  major  cities  are 
working  with.  One  out  of  five  people  in  Philadelphia  is  receiving 
some  form  of  welfare. 

I  would  like  to  close  and  simply  say  that  we  strongly  believe  that 
JTPA  has  the  chance  to  succeed  where  no  other  government  pro- 
gram— manpower  or  CETA — has  even  come  close.  So  far,  JTPA  has 
the  most  effective  track  record  based  on  what  the  Federal  perform- 
ance standards  have  measured  over  the  years.  Mainly,  that  focus 
has  been  on  the  number  of  people  placed  in  jobs. 

Our  experience  shows  that  the  private  sector  must  be  closely 
linked  to  any  successful  employment  and  training  initiative.  PIC's 
and  JTPA  already  have  established  relationships  with  the  private 
sector  which,  if  enhanced,  can  yield  greater  results  and  benefits  to 
the  clients  we  serve  and  to  the  economy  in  general. 

Thank  you. 

[The  prepared  statement  of  Ms.  Irving  follows:] 
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TESTIMONY 


PREFACE 


Good  morning.  Chairman  Conyers  and  members  of  the 
subcommittee,  I  am  Patricia  Irving,  President  and  Chief 
Executive  Officer  of  the  Private  Industry  Council  of 
Philadelphia.  I  aun  glad  that  you  have  given  me  the 
opportunity  to  tell  you  more  about  the  functioning  of  the  Job 
Training  Partnership  Act  (JTPA)  at  the  local  level. 

In  Philadelphia,  the  Private  Industry  Council  is  a  non  profit 
corporation  that  has  been  the  administrative  organization 
responsible  for  funding  under  the  Federal  Job  Training 
Partnership  Act  since  19  84. 

On  June  6,  1990,  the  Board  of  Directors  of  the  PIC  unanimously 
approved  a  new  mission  statement  for  the  new  President, 
Patricia  E.  Irving,  to  implement  immediately.  In  accordance 
with  the  Job  Training  Partnership  Act  (JTPA)  and  the  Job 
Opportunities  and  Basic  Skills  (JOBS)  Program,  the 
Philadelphia  PIC  was  given  clear  direction  by  the  Board  to 
transition  "harder- to- serve"  clients  from  dependency  to 
economic  self-sufficiency.  To  accomplish  that  goal,  the 
organization  made  a  major  shift  from  an  employer- focused  to  a 
client- focused/employer-driven" system. 

Through  the  Request  for  Proposal  (RFP)  process,  the  PIC 
advertised  for  comprehensive  programs  that  offered  additional 
services,  such  as  remedial  education,  life  skills  training, 
intensive  job  readiness  training,  professional  counseling 
services,  and  case  management  in  addition  to  Job  Specific 
Skills  (JSS)  training.  We  also  added  a  second  component- -a 
pre-training  (feeder)  type  of  program  to  prepare  the 
"dif f icult-to-serve"  clients  for  skill-based  learning 
programs.  The  two  tier  approach  worked  and  it  worked  even 
better  after  we  implemented  the  "Fortune  Center"  in  January, 
1991  to  assess  each  applicant's  basic  skills,  interests  and 
aptitudes.  But,  in  order  to  build  capacity  and  thoroughly 
assess  each  applicant,  we  added  a  third  tier- -a  training 
readiness  component  in  January,  1992. 

Altogether,  we  are  utilizing  a  sequential  training  process  or 
a  three  tier  structure  to  transition  "harder- to- serve"  clients 
from  dependency  to  self -suf f iciencjr. 

Realizing  that  the  PIC  had  sufficient  funds  to  serve  less  than 
5%  of  the  disadvantaged  community  who  needed  training  and 
employment  services  and  that  comprehensive  programs  are  more 
expensive  to  operate,  we  decided  to  leverage  our  funds, 
resources  and  services  whenever  and  wherever  feasible  to 
offset  the  increased  costs. 
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We  began  the  leveraging  process  by  integrating  JTPA  and  JOBS 
since  both  programs  had  compatible  goals  and  outcomes.  By 
integrating  two  programs  into  one,  we  reduced,  if  not 
eliminated,  duplicate  administrative  costs.  We  also 
coordinated  the  delivery  of  support  services  with  County 
Assistance  to  address  the  diverse  needs  of  the  harder- to-serve 
clients. 

The  PIC'S  partnership  with  County  Assistance  has  worked 
exceptionally  well  and  continues  to  flourish.  But  more 
importantly,  this  experience  encouraged  and  propelled  the  PIC 
to  form  other  partnerships  throughout  the  community  which  is 
explained  in  the  PIC's  Progress  Report. 
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II.   PHILADELPHIA  PIC'S  APPROACH  TO  TRAINING  AKD  KMPLOYMBMT; 

The  Philadelphia  Private  Industry  Council  only  funds  training 
prograuns  in  occupations  where  jobs  exist.  We  specifically 
seek  placement  in  positions  that  pay  substantially  more  but 
not  less  than  $6.00  per  hour  plus  fringe  benefits. 

A.  Recruitment: 

The  training  process  begins  with  outreach  and 
recruitment.  There  are  three  primary  sources  of 
applicants: 

■  Six  (6)  PIC  Referral  Centers- -Community-Based 
organizations  strategically  located  throughout  the 
city  in  areas  of  high  unemployment. 

■  Nineteen  (19)  County  Assistance  Offices- -The  PIC 
CO- locates  staff  at  each  County  Assistance  office. 
PIC  Client  Service  Representatives  and  Employment 
and  Training  personnel  (ETP)  at  County  Assistance 
work  together  to  recruit  and  screen  welfare 
recipients  for  PIC  programs. 

■  Seven  (7)  Job  Centers- -located  throughout  the  city, 
PIC  staff  are  scheduled  in  each  Job  Service  Center 
to  recruit  applicants  for  PIC- funded  training 
programs . 

B.  Assessment  Center: 

All  applicants. are  referred  to  the  "Fortune  Center"  for 
initial  assessment..  We  use  a  computerized  series  of 
tests  (3  1/2  hours)  to  measure  each  applicant's  basic 
skills,  interest  and  aptitude.  Test  results  are 
discussed  with  each  applicant.  Program  options  and 
choices  are  presented  to  the  client  and  the  assessment 
counselor  makes  recommendations,  but,  the  client 
exercises  his/her  right  of  final  selection  in  most 
instances. 


Populations  served: 


Long  term  welfare  recipients 

Transitionally  needy 

Long  term  unemployed/disadvantaged  adults 

Homeless 

Dirug  offenders 

Ex- offenders 

High  school  dropouts 

Teen  parents 

At-risk  youth  (in  and  out  of  school) 
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■  Older  workers 

■  Dislocated  workers 

Client  prof iles- -common  denominators: 

■  Most  clients,  including  dislocated  workers, 
generally  lack  self-esteem  and   self-confidence. 

■  Most  clients,  including  dislocated  workers,  are 
deficient  in  basic  skills,  job  skills  interpersonal 
skills  and  critical  thinking  skills. 

■  A  significant  number  of  clients  need  to  acquire  a 
high  school  diploma  or  GED  equivalent  while 
building  basic  skills  in  preparation  for  skill 
based  training  programs. 

■  Welfare  recipients  will  not  leave  welfare  for 
minimxam  wage  jobs  with  no  benefits. 

■  Dislocated  workers  who  have  been  laid- off  from  low 
skilled/high-paying  jobs  need  extensive  training 
for  occupations  that  pay  considerably  less  which  is 
often  a  difficult  adjustment. 

Based  on  assessment  outcomes,  an  Educational  and 
Employability  Development  Plan  (EEDP)  is  completed  by  the 
assessment  counselor  and  the  client.  According  to  the 
EEDP,  the  client  is  referred  to  the  appropriate  prograim 
in  the  sequential  training  process. 

C.   Description  of  Sequential  Training  Process: 

The  PIC  operates  three-phases  of  sequential  training 
programs  to  assist  individuals  in  gaining  the 
educational,  occupational  and  job  preparation  skills  they 
need  to  enter  and  succeed  in  the  work  place.  The 
sequential  phases,  the  populations  served,  the  curricula 
and  the  expected  outcomes  include: 

Phase  I:   Training -Readiness  Program 

The  purpose  of  the  first  tier  of  training  is  to: 

■  thoroughly  assess  the  client's  basic  skills; 

■  provide  an  immediate  activity  that  will  help 
sustain  client  interest  in  training; 

>    increase  client  motivation  for  success;  and 

■  prepare  clients  to  successfully  participate 
and  complete  either  PIC  feeder  or  job  specific 
skills  training  programs. 

The  Training  Readiness  Prograun  provides  the  following 
services  to  harder- to- serve  Philadelphia  residents  who 
possess  little  or  no  work  history: 
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■  Introduction  to  Basic  Skills  (reading,  writing 
and  math) 

■  Life/Coping  Skills 

■  Counseling 

■  Case  Management 

Each  year,  an  estimated  25-30%  of  PIC's  trainees  will 
attend  the  Training -Readiness  program,  which  operates 
from  2  to  6  weeks  with  staggered  entry  and  exit. 
Training  Readiness  Program  participants  transition  into 
a  PIC- funded  feeder  or  Job  Specific  Skills  program. 

Phase  II:  Feeder  Program 

The  purpose  of  the  second  tier  of  training  is  to  assist 
trainees  in: 

increasing  self-esteem; 

gaining  realistic  employment  goals; 

elevating  academic  skills; 

removing  barriers  to  employment  success; 

obtaining  coping  and  life  skills;  and 

acquiring  knowledge  of  the  job  market  and  the 

skills  required  to  enter  it. 

Feeder  programs  serve  harder- to- serve  Philadelphia 
residents  who  possess  little  or  no  work  history',  are  PIC- 
eligible  and  are  reading  between  the  5 . 0  and  6 . 9  grade 
levels.  Trainees  also  include  graduates  of  PIC's 
Training- Readiness  program. 

Comprehensive  feeder  programs  include: 

Basic  Skills 

Life  Skills 

Job  Readiness 

Career  Exploration 

Counseling  and  Case  Management 

Each  year,  an  estimated  20%  of  PIC's  trainees  will  attend 
feeder  progrcims,  which  vary  in  length  from  10  to  16  weeks 
with  staggered  entry  and  exit. 

The  feeder  program  outcomes  include  transition  into  a 
PIC- funded  Job  Specific  Skills  program,  a  non-PIC  funded 
program,  or  a  full-time  unsubsidized  job  (minimum  of  30 
hours  per  week)  at  a  wage  of  $6.00  or  more  with  en^loyer- 
sponsored  (at  least  50%)  fringe  benefits. 


153 


Phase  III:  Job  Specific  Skills  Program 

The  purpose  of  the  third  tier  of  training  is  to  assist 
trainees  in: 

■  obtaining  specific  occupational  or  job  skills 

■  elevating  basic  academic  skills; 

■  .  preparing  for  success  in  the  world  of  work 
(job  readiness) ; 

■  obtaining  coping  and  life  skills;  and 

■  acquiring  knowledge  of  the  job  market  and  the 
skills  required  to  enter  it. 

Job  Specific  Skills  programs  serve  harder -to -serve 
Philadelphia  residents  who  possess  little  or  no  work 
history,  are  PIC-eligible  and  are  reading  at  or  cQDOve  the 
7.0  grade  level.  Trainees  include  graduates  of  PIC's 
feeder  system  and/or  Training -Readiness  Program. 

Comprehensive  Job  Specific  Skills  (JSS)  programs  include: 

Occupational  Skills  /    / 

Basic  Skills 

Life  Skills 

Job  Readiness 

Counseling 

Case  Management 

Each  year,  nearly  all  of  PIC's  trainees  will  attend  job 
specific  skills  programs,  which  operate  from  4  to  9 
months  in  length. 

The  outcome  for  Job  Specific  Skills  prograuns  is  placement 
into  a  full-time  unsubsidized  job  (minim\im  of  30  hours 
per  week)  at  a  wage  of  $6.00  or  more  with  employer- 
sponsored  (at  least  50%)  fringe  benefits. 

D.    Method  of  Instruction: 

We  use  competency -based  instruction  to  measure  and 
monitor  the  client's  progress,  or  lack  thereof, 
throughout  the  progrcmi  (Positive  feedback  to  clients  also 
builds  self-confidence  and  self-esteem) .  Most  PIC- funded 
prograuns  utilize  a  staggered  enrollment  process  whereby 
a  specified  number  of  trainees  are  enrolled  each  or  every 
other  month.  Graduates  exit  the  program  when  all 
competencies  have  been  fulfilled  and  placement  has 
occurred  in  a  training- related  occupation.  If  a  trainee 
is  not  ready  to  exit  the  program  we  advise  our 
subcontractors  to  work  with  the  trainee  until  she/he  is 
completely  trained  and  prepared  to  compete  in  the  labor 
market . 
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E.  Monitoring: 

PIC- funded  programs  are  monitored  programmatically  and 
fiscally  on  a  monthly  basis  according  to  the  terms  and 
conditions  of  the  contract.  When  problems  are  identified 
that  require  immediate  attention,  we  remain  involved 
until  the  situation  is  rectified  or  remedied. 

We  also  monitor  our  internal  operation  programmatically 
and  fiscally  according  to  performance  goals,  objectives 
and  the  operating  budget,  as  approved  by  the  Board  of 
Directors.  We  troubleshoot  internal  systems  and 
procedures  and  collect  and  analyze  data  to  measure 
progress  and  the  cost  effectiveness  of  the  organization 
and  that  of  our  training  providers. 

F.  Performance: 

The  Philadelphia  PIC  has  exceeded  all  federal/state 
r-  ,  ■  mandated  performance  standards  for  two  consecutive  years 
with  one  (1)  exception  --  the  Entered  Employment  Rate  for 
Dislocated  Workers.  We  missed  the  standard  by  a  hair. 
A  significant  number  of  clients  in  the  dislocated  worker 
category  elected  to  collect  the  extended  benefits  rather 
than  accept  employment. 
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III.  BUSINESS  ADVISORY  COUNCIL 

Facing  a  tight  laibor  market,  massive  layoffs  and  plant 
closings  in  the  City  and  surrounding  counties,  we  instituted 
a  new  PIC-Business  Partnership,  called  The  Business  Advisory 
Council  (BAC) . 

The  Business  Advisory  Council  is  composed  of  14  major 
Philadelphia  based  employers  and/or  industries.  These 
employers  have  the  experience  and  expertise  to  train  their 
employees  and  they  are  willing  and  well -prepared  to  provide 
technical  assistance  to  the  PIC. 

The  Council  members  have  made  the  following  recommendations  to 
the  Private  Industry  Council  (PIC)  regarding  structural 
changes  in  the  labor  market : 

■  Due  to  the  current  job  market  trend  focusing  on  multiple 
skills  PIC  training  providers  should  be  encouraged  to 
train  participants  more  generically  and  for  a  wider 
variety  of  jobs.  For  example,  the  inclusion  of  a  strong 
math  component,  either  bookkeeping  or  accounting 
principles,  enhances  the  marketability  of  PIC  graduates 
in  a  variety  of  clerical  occupations. 

■  The  major  hiring  characteristics  for  many  entry  level 
positions  include:  computer  literacy,  excellent 
communication  skills  (interpersonal  and  critical  thinking 
skills)  and  previous  work  experience.  Therefore,  a 
component  that  focuses  on  interpersonal  and  critical 
thinking  skills  should  be  added  to  all  training  programs. 

■  BAC  members  advised  us  that  internships,  apprenticeships, 
and/or  OJT  might  be  considered  as  substitutes  for 
previous  work  experience  by  many  employers.  They  also 
held  the  position  that  a  centralized  job  development 
strategy  would  be  very  effective  in  today's  economy. 

■  BAC  members  think  that  PIC  trainees  can  gain  meaningful 
work  experience  from  the  temporary  positions  which  are 
expected  to  materialize  after  the  Family  Leave  Act 
becomes  effective  in  August,  1993  as  an  alternative  to 
internships  and/or  OJT. 

■  BAC  members  have  expressed  interest  in  being  involved  in 
the  sequential  training  as  PIC  training  providers  and/or 
consultants.  They  are  also  interested  in  the  development 
and  implementation  of  a  "train  the  trainers"  program  for 
PIC  subcontractors. 

■  BAC  members  are  interested  in  assisting  us  with  post 
assessment  by  administering  the  fourth  tier  of  training 
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for  graduates  from  one  or  several  subcontractors  who  were 
not  successful  in  securing  permanent  jobs  at  the  end  of 
training.  In  fact,  BAG  members  as  a  group  expressed  an 
interest  in  forming  a  consortium  to  conduct  clerical 
training. 

■  A  centralized  Job  Development  Unit  {one  stop  shopping  for 
employers)  is  a  strong  motivator  for  enployer  involvement 
primarily  because  it  would  reduce  recruitment  and 
training  costs  for  employers  as  long  as  applicants  are 
well  trained. 

As  a  result  of  the  PIC-business  partnership,  the  PIC  of 
Philadelphia  has  begun  to  combine  its  resources  with  member 
companies  of  the  Business  Advisory  Council.  Together,  we  are 
in  the  process  of : 

■  Establishing  a  centralized  Job  Development  Unit  (one-stop 
shopping  for  employers)  in  partnership  with  the  Business 
Advisory  Council,  County  Assistance  Office  and  Job 
Service.  We  are  in  the  process  of  renovating  space  to 
accommodate  a  multi- faceted  Job  Development  Center  to 
post -assess  PIC  graduates  before  placing  them  in 
positions  that  lead  to  economic  self-sufficiency. 

■  Standardizing  curricula  to  produce  state  of  the  art 
training  which  will  be  consistent  with  the  needs  of 
businesses,  today  and  in  the  future. 

■  Working  with  member  companies  of  the  Business  Advisory 
Council  to  implement  state  of  the  art  training  programs 
in  clerical  and  allied  health  occupations  for  PIC 
trainees  who  successfully  completed  at  least  one  of  the 
programs  in  the  sequential  training  process,  but  did  not 
secure  employment  at  the  end  of  training.  100%  placement 
is  the  ultimate  goal. 

In  so  doing,  we  will  achieve  multiple  benefits;  PIC  graduates 
will  be  prepared  to  meet  the  competitive  personnel  needs  of 
businesses  and  close  the  skills  gap;  we  will  be  prepared  to 
support  a  local  economic  recovery;  and  we  will  be  able  to 
assist  our  clients  in  achieving  economic  self-sufficiency. 


157 


IV.   IMTBGRATION  WITH  TRAINING.  KDUCATION  &  SOCIAL  SKRVICB  SUPPORT 
PROGRAMS 

The  existing  partnerships  and  working  relationships  to 
leverage  PIC  funds  and  resources  on  behalf  of  PIC  trainees 
are: 

Board  of  Directors: 

A  progressive,  proactive  Chairman  of  the  Board  and  an  actively 
involved,  well-informed  Board  of  Directors  act  as  PIC 
ambassadors  and  identify  potential  resources  in  the  community. 

Agencies  and  Organizations: 

County  Assistance,  Philadelphia  School  District,  Philadelphia 
Department  of  Commerce,  Philadelphia  Department  of  Recreation, 
Employment  Service,  Greater  Philadelphia  Chamber  of  Commerce, 
Office  of  Housing  and  Community  Development,  Mayor's 
Commission  on  Literacy,  Mayor's  Commission  on  Aging,  Mayor's 
Commission  on  Homelessness,  Philadelphia  Housing  Authority, 
Philadelphia  Industrial  Development  Corporation,  Philadelphia 
Citywide  Development  Corporation,  Greater  Philadelphia  Urban 
Affairs  Coalition,  United  Way  of  Southeastern  Pennsylvania, 
and  the  Business  Advisory  Council. 

Colleges  and  Universities: 

Community  College  of  Philadelphia,  Temple  University,  Lincoln 
University,  University  of  Pennsylvania,  Pennsylvania  State 
University,  Drexel  University,  Beaver  College  and  Pierce 
Junior  College. 

Foundations: 

William  Penn  Foundation,  Pew  Charitable  Trust  and  the  Beech 
Corporation. 

Union : 

AFL/CIO,  1199C  Hospital  Workers  Union,  Glazier's  Union  Local, 
and  the  Philadelphia  Federation  of  Teachers. 
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WHAT  WORKS  I 


Apprenticeship  models  of  training  (theory  and  hands-on 
experience)  are  the  most  effective  methods  of  training 
the  harder- to- serve  adult  and  youth  populations  and 
generally,  the  most  expensive.  However,  all  program 
designs  should  be  comprehensive,  holistic  and  capable  of 
removing  social  barriers  to  einployment  while  cultivating 
job  specific  skills  that  lead  to  permanent  employment. 

Based  on  the  "Garbage  In,  Garbage  Out"  theory,  an  in- 
depth  or  accurate  assessment  of  the  individual's  basic 
skills  interest  and  aptitude  is  critical  to  the  process 
of  matching  the  client  with  the  most  appropriate  training 
activity. 

PICs  should  seek  to  enhance  employer  involvement  in 
programs,  particularly  in  curriculum  design,  instruction 
and  the  use  of  internships.  Because  employers  are  the 
ultimate  consumers  of  our  products  --  trained  workers  -- 
we  must  obtain  their  input  for  developing  a  product  that 
will  be  useful. 

Programs  which  serve  adult  learners,  such  as  those 
involved  in  JTPA  Title  IIA,  who  have  failed  in 
traditional  education  settings  must  incorporate  non- 
traditional  learning  techniques  into  their  training 
prograuns.  Furthermore,  programs  should  all  use 
significant  hands-on  skills  training  and  basic  life 
skills  instruction. 

Employment  and  training  systems  should  be  "seamless"  -- 
there  should  be  no  gaps  in  instruction  or  in  timeliness. 
Clients,  once  motivated  to  enter  training,  must  be  able 
to  get  immediate  attention  and  should  not  need  to  wait 
for  program  openings  and  lose  their  encouragement. 

To  meet  the  ultimate  goal  of  JTPA  Title  IIA,  PICs  must 
understand  that  job  development  is  not  an  activity  that 
occurs  at  a  client's  graduation.  Job  development  must  be 
an  integral  part  of  the  design  of  any  program  because  it 
must  meet  the  needs  of  employers. 
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VI.   WHAT  DOBSN'T  WORK  I 


Quick  fix  solutions  (short  term  training)  do  not  produce 
durable  outcomes  for  the  harder- to- serve  clients. 

Single  focused  programs  or  stand  alone  activities  do  not 
work  and  are  not  cost-effective. 
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VII.  KKSURING  THE  EPFBCTIVBNESS  OF  PROGRAMS 

The  Philadelphia  PIC  ensures  the  effectiveness  of  its  programs 
in  the  following  ways: 

■  Through  the  competitive  Request  for  Proposal  (RFP) 
process,  proposers  are  guided  in  the  design  of 
comprehensive  training  progrcims  by  making  certain  that 
specific  components  are  adequately  addressed,  e.g. 
remediation,  life  skills,  and  job  development.  Proposals 
that  do  not  meet  PIC  guidelines  are  not  accepted. 

■  Proposals  are  not  only  analyzed  by  the  Operation's  staff, 
but  also  pre -audited  by  the  Finance  Department  to 
ascertain  the  reasonableness  of  costs. 

■  All  training  programs  are  reviewed  by  the  PIC's  Program 
Evaluation  Committee  (PEC),  a  subcommittee  of  the  PIC's 
Board  of  Directors,  comprised  of  seven  (7)  members  of  the 
human  resources  and/or  staff  development  business 
community.  The  PEC  is  responsible  for  the  overall 
evaluation,  selection  and  funding  recommendations  of 
programs  to  the  PIC  Board  of  Directors.  Meeting  monthly, 
PEC  assesses  program  designs  and  projected  outcomes 
against  industry  standards.  It  also  reviews  previous 
performance  and  compares  performance  and  costs  to  those 
of  other  similar  training  subcontractors. 

■  Contracts  or  legally  binding  documents  between  the  PIC 
and  its  subcontractors  are  fair  and  equitable,  with 
terms,  conditions  and  performance  criteria  clearly 
defined  and  legally  enforceable. 

■  The  external  and  internal  monitoring  process: 

External:  PIC  staff  visit  training  program  sites  on  a 
monthly  basis  interviewing  both  clients  and  program 
staff.  The  program  is  also  monitored  according  to  the 
terms  and  conditions  of  the  contract  and  the  finance 
department  monitors  spending  and  prograun  expenses. 

Internal:  We  consistently  monitor  internal  systems  and 
procedures  to  determine  the  operation's  effectiveness. 
Measuring  our  performance  and  progress  towards  PIC  goals 
and  objectives  is  closely  monitored  fiscally  and 
progreunmatically . 
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VIII.RBCOMMgHPATIONS  TO  IMPROVB  THB  KPPBCTIVgWBSS  OF 
JTPA/ASSESSMgMT  OP  JTPA  ^^fmrpn^wtfY^ 

■  A  number  of  our  suggestions  for  improving  JTPA  were 
reflected  in  the  recently  enacted  Job  Training  Reform 
Amendments  of  1992.   Examples  are: 

We  strongly  agree  with  Congress  and  the 
Administration  that  an  in-depth  assessment  is  the 
key  to  delivering  the  individualized  services  that 
will  lead  to  success  in  training  and  on  the  job. 

We  agree  that  linkages  with  education  and  welfare 
organizations  are  necessary  to  diversify  the 
services  we  offer  and  to  reach  the  population  that 
needs  us  most. 

■  JTPA  could  be  more  effective  if  there  were  better 
coordination  among  ALL  federal  agencies  in  terms  of 
regulations,  definitions,  income  eligibility 
requirements,  MIS  data.  For  example,  a  welfare  (HHS) 
recipient  living  in  svibsidized  housing  (HUD)  who  attends 
PIC  training  (JTPA)  is  screened  by  three  federally- funded 
agencies  and  has  three  sets  of  paperwork,  three  sets  of 
files,  documentation  and  reports.  Work  experience  wages 
received  by  the  client  while  in  a  training  progreun  can 
cause  a  reduction  in  welfare  benefits  and  an  increase  in 
rent. 

■  While  we  strongly  advocated  for  the  passage  of  the 
amendments  to  improve  services  across  the  board,  we  were 
disappointed  by  some  good  policies  that  were  changed  and 
others  that  were  not  addressed  at  all.  Most  significant 
of  those  issues  not  addressed  was  the  JTPA  funding 
formula.  While  we  accept  Congress'  challenge  to  work 
with  the  most  disadvantaged  population,  we  were 
frustrated  to  learn  that  funding  would  still  be  based 
largely  on  uneirqployment  figures  and  not  on  the 
economically  disadvantaged.  Other  policies  which  were 
added  vinder  the  amendments,  such  as  more  stringent 
targeting  and  certification  rules,  will  create  more 
restrictions  and  paperwork  while  minimizing  flexibility 
at  the  local  level. 
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IX.   RESPONSE  TO  MDRC  EVALUATION  OF  JTPA 

The  Manpower  Development  Research  Corporation  (MDRC) 
evaluation  of  the  Job  Training  Partnership  Act  under  Title  IIA 
had  significant  design  flaws  which  have  led  to  the  publication 
of  results  which  eibsolutely  can  not  be  accepted  as  accurate 
and  can  not  be  applied  to  the  entire  system  with  any  degree  of 
accuracy.  The  most  significant  discrepancy  in  the  study 
involved  the  use  of  a  random  saunple  of  cities;  unfortunately 
the  seUtple  was  by  no  means  random.  In  fact,  cities  had  the 
option  to  participate  in  the  study  and  the  largest  city  used 
had  a  population  of  only  200,000  individuals.  It  is  well 
known  that  large  and  small  cities  vary  widely  in  their 
approaches  to  training,  progreun  design  and  especially  client 
populations.  All  of  these  factors  have  an  impact  on  the 
results  of  any  study  on  en^loyment  and  training. 

In  light  of  the  new  JTPA  aunendments  and  the  age  of  the  study, 
it  would  be  more  fair  to  the  system  and  its  clients  to  perform 
a  truly  random  study  once  the  PICs  have  had  an  opportunity  to 
implement  the  new  changes  to  the  JTPA  system. 
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CONCLUSION 

Overall,  we  strongly  believe  that  JTPA  has  the  chance  to 
succeed  where  no  other  government  program,  like  Manpower  or 
CETA,  has  even  come  close.  So  far,  JTPA  has  the  most 
effective  track  record  based  on  what  the  federal  performance 
standards  have  measured  over  the  years.  Mainly,  that  focus 
has  been  on  the  number  of  people  placed  in  jobs.  Our 
experience  shows  that  the  private  sector  must  be  closely 
linked  to  any  successful  employment  and  training  initiative. 
PICs  and  JTPA  already  have  an  established  relationship  with 
the  private  sector  which  can  be  enhanced  to  yield  greater 
benefits  to  the  system  and  the  clients. 
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XI. 

JTPA  Tide  HA  78%,  3% 

Program  Year  1991 

Statistical  Information 

L 

Participants  Served 

Number 

Perca 

Adults 
Youths 

Older  Workers 
TOTAL 

1,148 

1,158 

127 

2,433 

47.2 
47.6 

5,2 
100.0 

IL 

Client  Demoeraohics 

Client  Racial  Composition 

Black 

White 

Hispanic 

All  Others 

1.634 
449 
210 
140 

67.2 
18.5 
8.6 

5.7 

Male 
Female 

853 
1,580 

35.1 
64.9 

Client  Characteristics 

nL 


Lack  Significant  Work  History 

Receiving  Public  Assistance 

High  School  Drop  Outs 

Client  Reading  Levels 

Above  7th  Grade 
Below  7th  Grade 

Client  Wages 


2,140 

1,515 

612 


1,539 
894 


PRIOR  to  JTPA 

Wage  Rate  (w /prior  work  history)    $6.39 

Wage  Rate  (w/o  prior  work  history)    $0 

Welfare  Payments  $383.66 

Enrollment  Costs 

Average  Cost  Per  Enrollment:  $3,555.00 

Adult  $4,400.00 

Youth  2,910.00 

Older  Worker     1,805.00 


Total  Expended: 


$8,650,260.00 
17 


88.0 


62.3 

25.2 

63.3 
36.7 

POST  JTPA 

$7.08 

Percentage 

10.8 

$6.42 

100 

$38.91 

(89.9) 
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pja  cuBNTPLDW  cHAfrr 


JOB 
PLACEMENT 


\ 


JOB  SPECIFIC  SKILLS 

•Occupational  Skills 

•  Basic  Skills 
•Life  Skills 

•  Job  Readiness 

•  Counseling 


FEEDER  PROGRAMS 

•Basic  Skills 
•Ufe  Skills 

•  Job  Readiness 
•Career  Exploration 

•  Counseling 


NON  -  PIC 
-       FUNDED 
PROGRAMS 


TRAINING-READINESS  PROGRAM 

•  U^/Cop^ng  Skills 

•  Intro,  to  Basic  Skills 


CLIENT  ASSESSMENT 

•  Interest 

•  Aptitude 

I^^H 

•  Reading  &  Math 

^H 

^l^l 

^^H^H 

COMMUNITY  SERVICES 

•  Literacy  (PREP) 

•  Housing 

•  Substance  Abuse  & 

Domestic  Violence 

Prevention 

■  "      "^  '  "   ■  ■ ' 
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Mr.  Peterson.  Thank  you,  Ms.  Irving.  I  appreciate  it.  Next,  we 
are  going  to  hear  from  Jon  Gerson. 

STATEMENT  OF  JON  A.  GERSON,  DIRECTOR,  OFFICE  OF 
ECONOMIC  DEVELOPMENT,  MONTGOMERY  COUNTY,  MD 

Mr.  Gerson.  I  am  honored  to  have  been  invited  to  appear  before 
your  subcommittee  today.  I  hope  that  my  brief  remarks  will  assist 
you  in  your  examination  of  the  effectiveness  of  the  JTPA  and  our 
Nation's  PIC's  and  employment  and  training  initiatives  in  general. 

Obviously,  when  it  comes  to  creating  a  community,  and  even  a 
Nation,  that  is  economically  competitive,  the  most  important  thing 
that  we  have  to  do  is  to  have  an  economy  in  which  everyone  gets 
to  participate  and  be  their  full  height.  That  is  why  effective  em- 
ployment and  training  programs  are  so  important. 

Immediately  upon  assuming  office,  the  current  county  executive 
of  Montgomery  County  made  employment  and  training  a  priority 
for  his  administration  and  insisted  that  several  changes  to  the  net- 
work take  place.  I  would  like  to  briefly  present  some  information 
on  why  this  decision  was  made  and  what  Montgomery  County  is 
attempting  to  achieve  by  revamping  the  way  it  designs,  operates, 
and  evaluates  its  job  training  endeavors. 

By  way  of  background,  Job  Training  Partnership  Act  programs, 
until  recently,  were  administered  by  our  local  community  college. 
Our  private  industry  council  acted  in  an  advisory  capacity  and  pro- 
vided basic  oversight  of  these  endeavors,  but  did  not  have  any  legal 
authority  over  their  operations. 

In  1991,  the  Montgomery  County  Private  Industry  Council  incor- 
porated as  a  nonprofit  entity  and  became  the  official  grant  recipi- 
ent and  administrator  of  all  Federal  and  State  mandated  employ- 
ment and  training  programs.  This  important  move  was  coupled 
with  a  transfer  of  oversight  responsibility  on  the  part  of  the  county 
government  from  our  department  of  family  resources,  which  has  a 
social  service  orientation,  to  the  office  of  economic  development, 
which  I  direct,  which  is  oriented  toward  the  needs  of  business.  Our 
feeling  is  that  matching  people  with  jobs  is  a  business  issue,  not 
a  social  service  issue. 

In  reviewing  why  Montgomery  County  government  has  made  a 
concerted  effort  to  embark  on  a  new  direction  for  its  job  training 
system,  several  factors  come  to  mind: 

The  first  is  that  the  county  government  recognized  that  its  most 
valuable  asset  was  its  highly  educated  and  skilled  work  force.  In 
fact,  we  put  together  our  strategic  plan  for  economic  development 
around  enhancing  our  labor  force. 

Montgomery  County,  MD,  is  becoming  much  more  diverse.  We 
now  have  more  homeless,  more  speakers  of  English  as  a  second 
language,  and  immigrants,  than  ever  before. 

Our  countj^s  economy — and  certain  key  industries,  such  as  bank- 
ing, retail,  construction,  and  real  estate — are  not  going  to  operate 
as  they  have  in  the  past.  While  they  were  the  key  drivers  of  our 
economy  in  the  past  decade,  it  is  clear  that  the  Federal  laboratories 
in  our  community,  like  NIH  and  FDA,  along  with  the  high-tech  in- 
dustries which  support  them,  are  the  ones  that  are  going  to  create 
jobs  for  all  sectors  in  the  future. 
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The  training  needs  of  our  local  companies  are  becoming  much 
more  complex  as  emerging  forms  of  technology  enter  the  workplace 
on  a  daily  basis. 

Government,  having  declining  resources,  is  being  forced  to  de- 
velop cost-saving  measures.  If  the  recession  has  oflFered  us  any  op- 
portunity, it  is  an  opportunity  to  refocus  and  to  reprioritize  so  we 
can  figure  out  how  to  be  more  efficient  and  emerge  from  the  cur- 
rent recession  in  an  even  more  competitive  manner.  Indeed,  we  are 
learning  how  to  do  more  with  less. 

You  are  aware  that  the  changes  I  have  described  are  not  unique 
to  Montgomery  County,  and  can  be  found  in  your  own  districts  and 
throughout  the  Nation.  The  decision  to  redirect  employment  and 
training  systems  is  taking  place  throughout  the  country. 

Let  me  point  out,  however,  that  while  the  Montgomery  County 
PIC  is  responsible  for  taking  our  employment  and  training  system 
in  a  new  direction,  they  are  not  doing  it  alone.  We  are  ensuring 
that  the  PIC  has  a  close  working  relationship  with  not  only  the  o^ 
fice  of  economic  development,  but  with  other  county  entities  such 
as  our  health,  social  service,  school  system,  and  housing  endeavors. 

The  organization  is  also  building  a  quality  partnership  with  our 
local  business  community.  We  consider  the  direction  to  be  a  three- 
way  partnership  in  terms  of  a  public,  private,  and  nonprofit  part- 
nership. 

To  be  candid,  we  really  didn't  have  a  choice  or  any  alternatives 
in  making  the  alterations  I  have  described.  We  recognize  that 
change  is  imminent,  and,  unless  we  respond  to  our  changing  envi- 
ronment, we  are  going  to  lose  our  competitive  edge. 

Do  JTPA  programs  have  the  ability  to  adjust  to  external  factors? 
More  importantly,  do  they  have  the  capacity  to  facilitate  the  kind 
of  change  which  may  be  needed  in  the  Nation's  employment  and 
training  system?  If  not,  alterations  in  the  law  may  be  necessary. 

Montgomery  County  is  mandating  its  private  industry  council, 
which  as  I  said,  is  the  official  administrator  of  all  our  job  training 
programs,  to  embark  on  two  important  functions: 

First,  make  employment  and  training  initiatives  more  responsive 
to  the  needs  of  local  employers;  and  second,  act  as  the  central  hub 
for  all  job  training  efforts  in  the  county. 

The  private  industry  council  has  been  directed  to  make  job  place- 
ment tne  key  ingredient  in  administering  Federal  and  State  man- 
dated job  training  initiatives.  This  is  based  on  the  realization  that 
unless  we  produce  people  with  the  right  skills  for  the  jobs  in  our 
community,  we  are  really  wasting  our  time.  This  is  also  easier  said 
than  done  and  dictates  a  new  way  of  doing  business. 

The  PIC's  and  the  JTPA  programs  need  to  be  more  responsive 
to  the  employers'  needs  and  respond  to  the  ultimate  goal  of  job 
placement. 

Labor  market,  demographic,  and  economic  trends  have  to  be  ana- 
lyzed and  projected.  It  doesn  t  make  any  sense  in  our  community 
to  teach  people  bricklaying  when  we  project  less  construction  activ- 
ity in  the  future.  Meanwhile,  nearly  a  third  of  our  high-tech  indus- 
tries are  telling  us  that  they  can't  find  entry  level  people  to  put 
things  in  place  or  to  deal  with  test  tubes. 

The  needs  of  the  employers  have  to  be  communicated  and  unmet 
needs  must  be  identified.  There's  a  disconnect. 


168 

Finally,  there  must  be  a  matching  vehicle  to  allow  employers  and 
job  seekers  to  connect.  In  Montgomery  County's  case,  we  are  talk- 
ing about  a  centralized  clearinghouse — a  one-stop  shop  that  is  user 
friendly  to  both  the  small  employer  who,  as  you  know,  is  the  one 
who  is  producing  most  of  the  jobs,  when  he  is  seeking  a  worker, 
as  well  as  for  the  job  seeker. 

All  of  this  implies  a  closer  working  relationship  with  the  business 
community,  a  partnership  which,  in  Montgomery  County's  case, 
has  been  facilitated  by  local  government. 

We  have  also  directed  our  private  industry  council  to  be  the  voice 
of  the  entire  local  employment  and  training  system  and  to  coordi- 
nate job  training  programs,  whether  they  are  funded  through  JTPA 
or  not.  We  have  insisted  that  all  JTPA  training  activities  be  coordi- 
nated with  the  ancillary  services  which  are  needed  to  assist  the  cli- 
ents it  serves. 

In  addition  to  providing  support  for  the  administration  of  JTPA 
programs,  Montgomery  County  appropriates  an  additional  $3  mil- 
lion annually  for  16  distinct  employment  and  training  programs. 
Many  of  these  operate  out  of  multiple  geographic  sites  and  through 
several  nonprofit  organizations  and  other  institutions,  such  as  our 
school  system. 

At  one  point,  we  coimted  up  to  65  different  places  with  fiscal  ties 
to  the  county  government  where  a  citizen  could  go  to  receive  job 
training  assistance  or  other  services.  This  disjointed  system,  or 
lack  of  a  system,  has  caused  considerable  frustration  on  our  part 
as  well  as  that  of  participants  and  employers.  If  you  were  a  Jewish 
refugee  from  Russia,  you  went  to  one  place.  If  you  were  a  woman 
re-entering  the  marketplace,  you  went  to  another.  It  wasn't  work- 
ing. 

To  ensure  the  county  is  getting  the  most  from  its  resources,  we 
have  asked  our  PIC  to  build  an  employment  and  training  system 
which  has  a  common  mission  among  all  the  parts  operating  in  it, 
which  sets  annual  performance  standards,  and  coordinates  plan- 
ning, intake,  and  placement  efforts.  What  we  are  attempting  to  do 
is  to  maximize  those  resources  and  eliminate  any  duplication. 

We  feel  this  is  critical  to  the  effective  functioning  of  job  training 
programs  and  suggest  that  you  examine  the  possibility  of  giving 
PIC's  across  the  country,  through  their  JTPA  allocations,  the  fiscal 
resources  necessary  to  develop  this  type  of  coordinated  approach. 
While  an  important  one,  JTPA  programs  really  are  only  one  piece 
of  a  larger  job  training  picture,  and  job  training  is  only  one  aspect 
of  what  people  need. 

We  have  found  that  the  county  government  is  at  its  best  when 
it  invests  in  catalytic  endeavors — in  this  particular  case,  PIC  is  our 
catalyst — and  provides  the  resources  for  others  to  accomplish  a 
broad  goal  rather  than  attempting  to  control  hundreds  of  individual 
pieces. 

We  would  urge  you  to  consider  this  coordinated  approach  to  em- 
ployment and  training  as  you  examine  current  JTPA  legislation. 

I  appreciate  the  opportunity  to  share  Montgomery  County's  expe- 
rience with  you. 

[The  prepared  statement  of  Mr.  Gerson  follows:] 
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TESTIMONY  OF: 

Jon  A.  Gerson 

Director 

Office  of  Economic  Development 

Montgomery  County,  Maryland 

BEFORE: 

U.S.  House  of  Representatives 

Government  Operations  Committee 

Employment,  Housing  and  Aviation  Subcomnittee 

Chair:  Representative  Collin  C.  Peterson 

April  29,  1993 

I  AM  HONORED  TO  HAVE  BEEN  INVITED  TO  APPEAR  TODAY  BEFORE  THE 
EMPLOYMENT,  HOUSING  AND  AVIATION  SUBCOMMITTEE  OF  THE  HOUSE  GOVERNMENT 
OPERATIONS  COMMITTEE.   I  HOPE  MY  BRIEF  REMARKS  WILL  ASSIST  YOU  IN  YOUR 
EXAMINATION  OF  THE  EFFECTIVENESS  OF  THE  JOB  TRAINING  PARTNERSHIP  ACT,  OUR 
NATION'S  PRIVATE  INDUSTRY  COUNCILS  AND  EMPLOYMENT  AND  TRAINING 
INITIATIVES  IN  GENERAL. 

IMMEDIATELY  UPON  ASSUMING  OFFICE,  THE  CURRENT  EXECUTIVE  OF 
MONTGOMERY  COUNTY,  MARYLAND,  MADE  EMPLOYMENT  AND  TRAINING  A  PRIORITY  FOR 
HIS  ADMINISTRATION  AND  INSISTED  THAT  SEVERAL  CHANGES  TO  OUR  JOB  TRAINING 
NETWORK  TAKE  PLACE.  I  WOULD  LIKE  TO  PRESENT  SOME  INFORMATION  ON  WHY  THIS 
DECISION  WAS  MADE,  AND  WHAI  MONTGOMERY  COUNTY  IS  ATTEMPTING  TO  ACHIEVE  BY 
REVAMPING  THE  WAY  IN  WHICH  IT  DESIGNS,  OPERATES  AND  EVALUATES  ITS  JOB 
TRAINING  ENDEAVORS. 
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BY  WAY  OF  BACKGROUND,  JOB  TRAINING  PARTNERSHIP  ACT  PROGRAMS  --  UNTIL 
RECENTLY  --  WERE  ADMINISTERED  BY  OUR  LOCAL  COMMUNITY  COLLEGE.  OUR 
PRIVATE  INDUSTRY  COUNCIL  ACTED  IN  AN  ADVISORY  CAPACITY  AND  PROVIDED  BASIC 
OVERSIGHT  OF  THESE  ENDEAVORS,  BUT  HAD  NO  LEGAL  AUTHORITY  OVER  THEIR 
OPERATIONS. 

IN  1991,  THE  MONTGOMERY  COUNTY  PRIVATE  INDUSTRY  COUNCIL  INCORPORATED 
AS  A  NONPROFIT  ENTITY  AND  BECAME  THE  OFFICIAL  GRANT  RECIPIENT  AND 
ADMINISTRATOR  OF  ALL  FEDERAL  AND  STATE  EMPLOYMENT  AND  TRAINING  PROGRAMS. 
THIS  IMPORTANT  MOVE  WAS  COUPLED  WITH  A  TRANSFER  OF  OVERSIGHT 
RESPONSIBILITY  ON  THE  PART  OF  THE  COUNTY  GOVERNMENT  FROM  OUR  DEPARTMENT 
OF  FAMILY  RESOURCES,  WHICH  HAS  A  SOCIAL  SERVICE  ORIENTATION,  TO  THE 
OFFICE  OF  ECONOMIC  DEVELOPMENT,  WHICH  IS  ORIENTED  TOWARD  THE  NEEDS  OF 
BUSINESS. 

IN  REVIEWING  Mdl  MONTGOMERY  COUNTY  GOVERNMENT  HAS  MADE  A  CONCERTED 
EFFORT  TO  EMBARK  UPON  A  NEW  DIRECTION  FOR  ITS  JOB  TRAINING  SYSTEM, 
SEVERAL  FACTORS  COME  TO  MIND: 

1.  THE  COUNTY  GOVERNMENT  RECOGNIZED  THAT  ITS  MOST  VALUABLE  ASSET 
IS  ITS  HIGHLY  EDUCATED  AND  SKILLED  WORKFORCE,  AND  HAS 
FORMULATED  ITS  LONG-RANGE  STRATEGIC  PLAN  FOR  ECONOMIC 
DEVELOPMENT  AROUND  ENHANCING  OUR  LABOR  FORCE. 

2.  THE  COUNTY'S  LABOR  FORCE  HAS  BECOME  MORE  DIVERSE.  AND  WE  NOW 
HAVE  MORE  HOMELESS.  ENGLISH  AS  A  SECOND  LANGUAGE  STUDENTS  AND 
IMMIGRANTS  THAN  EVER  BEFORE. 
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3.  THE  COUNTY'S  ECONOMY  --  AND  CERTAIN  KEY  INDUSTRIES  SUCH  AS 
BANKING,  RETAIL,  CONSTRUCTION  AND  REAL  ESTATE  --  WILL  MOST 
LIKELY  NOT  OPERATE  AS  THEY  HAVE  IN  THE  PAST. 

4.  THE  TRAINING  NEEDS  OF  OUR  LOCAL  COMPANIES  ARE  BECOMING  MORE 
COMPLEX,  AS  EMERGING  FORMS  OF  TECHNOLOGY  ENTER  THE  WORKPLACE 
ON  A  DAILY  BASIS. 

5.  GOVERNMENT,  DUE  TO  DECLINING  RESOURCES,  IS  BEING  FORCED  TO 
DEVELOP  COST  SAVING  MEASURES. 

AS  YOU  CAN  SEE,  THE  CHANGES  I  HAVE  DESCRIBED  ARE  NOT  UNIQUE  TO  OUR 
COMMUNITY  AND  CAN  BE  FOUND  THROUGHOUT  THE  COUNTRY.  THEY  ARE  ALSO  MAKING 
THE  DECISION  TO  REDIRECT  OUR  EMPLOYMENT  AND  TRAINING  SYSTEM  AN  ESSENTIAL 
FUNCTION  OF  THE  ACTIVITIES  OF  OUR  PRIVATE  INDUSTRY  COUNCIL  IN  THE  YEARS 
AHEAD. 


LET  ME  POINT  OUT,  HOWEVER,  THAT  WHILE  THE  MONTGOMERY  COUNTY  PIC  IS 
RESPONSIBLE  FOR  TAKING  OUR  EMPLOYMENT  AND  TRAINING  SYSTEM  IN  A  NEW 
DIRECTION,  THEY  ARE  NOT  DOING  THIS  ALONE!  WE  ARE  ENSURING  THE  PIC  HAS  A 
CLOSE  WORKING  RELATIONSHIP  NOT  ONLY  WITH  THE  OFFICE  OF  ECONOMIC 
DEVELOPMENT,  BUT  ALSO  WITH  OTHER  COUNTY  ENTITIES  INVOLVED  WITH  HEALTH, 
SOCIAL  SERVICE,  EDUCATION  AND  LOW-INCOME  HOUSING  ENDEAVORS.  THE 
ORGANIZATION  IS  ALSO  BUILDING  A  QUALITY  RELATIONSHIP  WITH  THE  LOCAL 
BUSINESS  ':r'"^'JNITY.  WE  CONSIDER  OUR  NEW  DIRECTION  TO  BE  ONE  OF  A 
THREE-WAY  PARTNERSHIP  --  A  PUBLIC,  PRIVATE,  NONPROFIT  PARTNERSHIP. 
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WE  REALLY  DIDN'T  HAVE  A  CHOICE,  OR  ANY  ALTERNATIVES,  IN  MAKING  THE 
ALTERATIONS  I  HAVE  DESCRIBED.  MONTGOMERY  COUNTY  REALIZES  THAT  CHANGE  IS 
IMMINENT,  AND  UNLESS  WE  RESPOND  TO  OUR  CHANGING  ENVIRONMENT,  WE  WILL  BE 
LEFT  BEHIND.  ANY  SYSTEM  --  BE  IT  JTPA  OR  EMPLOYMENT  AND  TRAINING  OR 
EDUCATION  --  MUST  TAKE  THIS  INTO  SERIOUS  CONSIDERATION. 

DO  JTPA  PROGRAMS  HAVE  THE  ABILITY  TO  ADJUST  TO  EXTERNAL  CHANGES? 
MORE  IMPORTANTLY,  DO  THEY  HAVE  THE  CAPACITY  TO  FACILITATE  THE  KIND  OF 
CHANGE  WHICH  MAY  BE  NEEDED  IN  THE  NATION'S  EMPLOYMENT  AND  TRAINING 
SYSTEM?  IF  NOT,  ALTERATIONS  TO  THE  LAW  MAY  BE  NECESSARY. 

MONTGOMERY  COUNTY  IS  MANDATING  ITS  PRIVATE  INDUSTRY  COUNCIL,  WHICH 
IS  THE  OFFICIAL  ADMINISTRATOR  OF  OUR  JOB  TRAINING  PROGRAMS,  TO  EMBARK  ON 
TWO  IMPORTANT  FUNCTIONS: 

1)  MAKE  EMPLOYMENT  AND  TRAINING  INITIATIVES  MORE  RESPONSIVE  TO 
THE  NEEDS  OF  LOCAL  EMPLOYERS;  and 

2)  ACT  AS  THE  CENTRAL  HUB  FOR  ALL  JOB  TRAINING  EFFORTS  IN  THE 
COUNTY. 

THE  MONTGOMERY  COUNTY  PRIVATE  INDUSTRY  COUNCIL  HAS  BEEN  DIRECTED  TO 
MAKE  JOB  PLACEMENT  THE  KEY  INGREDIENT  IN  ADMINISTERING  FEDERAL  AND  STATE 
MANDATED  JOB  TRAINING  INITIATIVES.  THIS  IS  BASED  ON  THE  REALIZATION  THAT 
UNLESS  WE  PRODUCE  PEOPLE  WITH  THE  RIGHT  SKILLS  FOR  THE  JOBS  WHICH  ARE 
AVAILABLE  IN  OUR  COMMUNITY,  WE  ARE  WASTING  OUR  TIME.  THIS  IS  ALSO  EASIER 
SAID  THAN  DONE  AND  DICTATES  A  NEW  WAY  OF  DOING  BUSINESS. 
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IN  ORDER  FOR  PICs  AND  JTPA  PROGRAMS  TO  BE  MORE  RESPONSIVE  TO 
EMPLOYER  NEEDS  AND  RESPOND  TO  THE  ULTIMATE  GOAL  OF  JOB  PLACEMENT,  WE  HAVE 
FOUND  THE  FOLLOWING  MUST  BE  ACCOMPLISHED: 


* 


* 


LABOR  MARKET,  DEMOGRAPHIC  AND  ECONOMIC  TRENDS  MUST  BE  ANAYLYZED 
AND  PROJECTED. 

THE  NEEDS  OF  EMPLOYERS  MUST  BE  COMMUNICATED,  AND  UNMET 
MARKETPLACE  NEEDS  IDENTIFIED. 


*  PROGRAMS  MUST  BE  DESIGNED  IN  RESPONSE  TO  THE  NEEDS  OF  THE  FUTURE. 

*  AND  FINALLY,  THERE  MUST  BE  A  MATCHING  VEHICLE  TO  ALLOW  EMPLOYERS 
AND  JOB  SEEKERS  TO  CONNECT.  IN  MONTGOMERY  COUNTY'S  CASE,  WE  ARE 
TALKING  ABOUT  A  CENTRALIZED  CLEARINGHOUSE. 

ALL  OF  THESE  IMPLY  A  CLOSER  WORKING  RELATIONSHIP  WITH  THE  BUSINESS 
COMMUNITY,  A  RELATIONSHIP  WHICH  IN  MONTGOMERY  COUNTY'S  CASE  HAS  BEEN 
FACILITATED  BY  THE  LOCAL  GOVERNMENT. 

MONTGOMERY  COUNTY  GOVERNMENT  HAS  ALSO  DIRECTED  ITS  PRIVATE  INDUSTRY 
COUNCIL  TO  BE  THE  VOICE  OF  OUR  ENTIRE  LOCAL  EMPLOYMENT  AND  TRAINING 
SYSTEM  AND  TO  COORDINATE  JOB  TRAINING  ACTIVITIES  WHETHER  THEY  ARE  FUNDED 
THROUGH  JTPA  1 KTITLEMENTS  OR  NOT.  WE  HAVE  ALSO  INSISTED  THAT  JOB 
TRAINING  ACTIVITIES  BE  COORDINATED  WITH  THE  ANCILLARY  SERVICES  WHICH  ARE 
NEEDED  TO  ASSIST  THE  CLIENTS  WE  ARE  TO  SERVE. 
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IN  ADDITION  TO  PROVIDING  SUPPORT  FOR  THE  ADMINISTRATION  OF  JTPA 
PROGRAMS,  THE  COUNTY  APPROPRIATES  $3  MILLION  ANNUALLY  FOR  16  DISTINCT 
EMPLOYMENT  AND  TRAINING  PROGRAMS.  MANY  OF  THESE  OPERATE  OUT  OF  MULTIPLE 
GEOGRAPHIC  SITES  AND  THROUGH  SEVERAL  NONPROFIT  ORGANIZATIONS  AND  OTHER 
INSTITUTIONS  SUCH  AS  OUR  PUBLIC  SCHOOL  SYSTEM.  AT  ONE  POINT,  WE  COUNTED 
UP  TO  65  PLACES,  WITH  FISCAL  TIES  TO  THE  COUNTY  GOVERNMENT,  WHERE  A 
CITIZEN  COULD  GO  TO  RECEIVE  JOB  TRAINING  ASSISTANCE  AND  ANCILLARY  SOCIAL 
SERVICES.   THIS  DISJOINTED  SYSTEM  --  OR  LACK  OF  A  SYSTEM  --  HAS  CAUSED 
CONSIDERABLE  FRUSTRATION  AND  CONFUSION  ON  THE  PART  OF  BOTH  PROGRAM 
PARTICIPANTS  AND  EMPLOYERS. 

TO  ENSURE  THE  COUNTY  IS  GETTING  THE  MOST  OF  ITS  PRECIOUS  RESOURCES, 
WE  INSTRUCTED  OUR  PRIVATE  INDUSTRY  COUNCIL  TO  BUILD  AN  EMPLOYMENT  AND 
TRAINING  SYSTEM  WHICH  HAS  A  COMMON  MISSION  AMONG  THE  PROGRAMS  OPERATING 
WITHIN  IT  .  .  .  WHICH  SETS  ANNUAL  PERFORMANCE  STANDARDS  .  .  .  WHICH 
COORDINATES  PLANNING,  INTAKE  AND  PLACEMENT  EFFORTS.  WHAT  WE'RE 
ATTEMPTING  TO  ACHIEVE  IS  THE  BEST  USE  OF  SCARCE  RESOURCES  BY  ELIMINATING 
ANY  DUPLICATION  WHICH  MAY  EXIST. 

WE  FEEL  THIS  IS  CRITICAL  TO  THE  EFFECTIVE  FUNCTIONING  OF  OUR  JOB 
TRAINING  PROGRAMS,  AND  SUGGEST  YOU  EXAMINE  THE  POSSIBILITY  OF  GIVING  PICs 
ACROSS  THE  COUNTRY  --  THROUGH  THEIR  JTPA  ENTITLEMENTS  --  THE  FISCAL 
RESOURCES  NECESSARY  TO  DEVELOP  THIS  TYPE  OF  COORDINATED  APPROACH.  WHILE 
AN  IMPORTANT  ONE,  JTPA  PROGRAMS  ARE  ONLY  ONE  PIECE  OF  THE  JOB  TRAINING 
PICTURE.  AND  JOB  TRAINING  IS  ONLY  ONE  ASPECT  OF  WHAT  SOME  OF  OUR 
CITIZENS  NEED. 
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WE  HAVE  FOUND  THAT  GOVERNMENT  IS  AT  ITS  BEST  WHEN  IT  INVESTS  IN 
CATALYTIC  ENDEAVORS  --  IN  THIS  PARTICULAR  CASE  PIC  IS  OUR  CATALYST  --  AND 
PROVIDES  THE  RESOURCES  FOR  OTHERS  TO  ACCOMPLISH  A  BROAD  GOAL  RATHER  THAN 
ATTEMPTING  TO  CONTROL  HUNDREDS  OF  INDIVIDUAL  PIECES.   I  URGE  YOU  TO 
CONSIDER  THIS  COORDINATED  APPROACH  TO  EMPLOYMENT  AND  TRAINING  AS  YOU 
EXAMINE  CURRENT  JTPA  LEGISLATION. 

THANK  YOU  FOR  THE  OPPORTUNITY  TO  SHARE  MONTGOMERY  COUNTY'S 
EXPERIENCE  WITH  YOU. 


176 

Mr.  Peterson.  Thank  you,  Mr.  Gerson.  Mr.  Zeller. 

STATEMENT  OF  JOHN  ZELLER,  EXECUTIVE  DIRECTOR,  MONT- 
GOMERY COUNTY  PRIVATE  INDUSTRY  COUNCIL,  MONTGOM- 
ERY COUNTY,  MD 

Mr.  Zeller.  Thank  you.  I  am  the  executive  director  of  the  Pri- 
vate Industry  Council  of  Montgomery  County.  I  thank  the  Chair  for 
the  invitation  to  provide  testimony  todav.  My  comments  should  be 
seen  in  concert  with  my  colleague,  Jon  Gerson,  who  has  given  some 
of  the  basis  for  the  recent  changes  within  the  county  as  well  as 
where  we  are  heading. 

As  he  has  said,  our  county  advocates  a  strong  work  force  develop- 
ment system  that  is  explicitly  linked  to  business  and  economic  life. 
My  testimony  focuses  on  the  implementation  of  this  at  an  oper- 
ational level. 

All  of  us  have  talked  about  the  delivery  of  JTPA  programs.  The 
question  of  what  works  and  what  does  not  is  dangerously  simplis- 
tic. 

Of  course,  when  a  service  delivery  area  is  able  to  piece  together 
that  constantly  shifting,  magical  combination  of  a  motivated  client 
who  needs  the  services  that  you  provide,  a  competent  service  pro- 
vider that  pulls  together  the  skills  training  with  appropriate 
preemployment  and  life  skills  training  and  possibly  contextual  re- 
mediation, and  then  have  these  services  initially  driven  by  a  local 
employer  who  has  a  need  for  workers  and  has  articulated  it,  then 
you  have  a  successful  program.  I  posit  that  this  is  the  model  of  a 
successful,  comprehensive  program.  Absent  one  of  these  elements, 
the  risk  of  failure  increases. 

The  reality  of  the  JTPA  system  as  it  has  operated  over  the  last 
number  of  years  is  that  we  work  with  many  more  people  than  can 
be  served,  all  of  whom  qualify  as  eligible  because  of  their  inability 
to  financially  sustain  themselves  without  relying  on  a  variety  of 
governmental  assistance  programs. 

JTPA  is  serving  people  who  have  not  been  served  well  by  other 
institutions.  For  people  with  a  solid  work  history,  job  readiness 
training  may  be  sufficient  to  attain  employment.  But  for  most  eco- 
nomically disadvantaged  clients  with  additional  barriers  to  employ- 
ment, skills  training  is  essential.  This  skills  training  should  always 
be  combined  with  employability  and  work  maturity  training.  Basic 
education  as  well  as  English  as  a  second  language  should  also  be 
provided  at  the  same  time,  according  to  need. 

Our  private  industry  coimcil  consciously  strives  to  serve  its  popu- 
lation in  an  equitable  fashion.  In  the  middle  of  this  current  pro- 
fram  year,  we  have  served  approximately  1,900  people  so  far. 
ixty-four  percent  are  female;  half  of  our  population  is  African 
American;  14  percent  Hispanic;  and  the  remaining  11  percent 
Asian.  These  numbers  reflect  the  gprowing  diversity  of  our  county, 
particularly  the  trend  of  the  increase  of  our  immigrant  population. 

The  amendments  that  have  recently  been  passed  do  address 
some  of  the  areas  of  concern  that  have  come  to  light  over  the  last 
number  of  years.  As  a  national  system,  I  think  that  this  is  good. 
Unfortunately,  it  tends  to  put  unnecessary  restrictions  on  jurisdic- 
tions— and  I  include  the  State  of  Maryland — that  have  been  doing 
a  fair  and  honest  job. 
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As  an  individual  responsible  for  operations  at  the  local  level,  I 
believe  that  the  amendments  have  oriented  us  in  much  more  of  a 
process  system — assessment  and  referral — as  opposed  to  outcome 
oriented. 

The  amendments  place  much  more  emphasis  on  serving  "at  risk 
youth,"  the  "hard  to  serve,"  and  "adults  most  in  need,"  legislating 
the  proportion  of  such  target  groups  to  be  served.  The  objective  as- 
sessment process  mandated  by  the  amendments  would  help  to  en- 
sure that  candidates  are  properly  assessed  before  referring  them  to 
employment  and  training  programs. 

The  requirement  that  such  assessments  trigger  the  enrollment  of 
applicants  into  our  MIS  system  and  the  development  of  an  individ- 
ual service  strategy  for  even  those  referred  to  other  organizations 
for  services,  I  believe,  places  a  greater  staff  burden  on  the  PIC  and 
shifts  resources  away  from  clients  determined  appropriate  for 
JTPA  services. 

Generally,  this  emphasis  on  process  translates  into  more  paper- 
work for  our  staff  to  cope  with  and  fewer  dollars — precious  aollars 
at  that — spent  on  actual  training  and  client  programs.  I  fear  that 
fewer  people  will  be  served  because  we  are  serving  more  paper. 

Additionally,  due  to  procurement  procedures  that  will  be  insti- 
tuted, "off-the-sheir  programs  will  predominate  and  smaller,  non- 
profit and  community  based  organizations  will  have  a  more  dif- 
ficult time  participating  as  service  providers.  This  would  be  unfor- 
tunate because  it  is  entities  such  as  these  who  tend  to  be  the  most 
flexible  and  responsive  to  changing  labor  market  and  social  reali- 
ties, and  these  are  the  kinds  of  services  that  we  believe  need  to  be 
procured. 

Mainly,  I  fear  that  the  amendments  may  set  up  the  JTPA  and 
the  PIC  system  for  failure  because  they  draw  resources  away  from 
direct  training  and  support  services.  In  discussions  with  my  col- 
leagues, there  is  a  sense  of  apprehension  that  the  lan^age  of  the 
legislation  and  regulations  is  framed  in  terms  of  the  ideal  and  in 
terms  of  the  comprehensive.  The  reality  is  that  much  is  being 
asked  with  insufficient  resource  and  authority. 

I  do  not  disagree  with  the  goal  of  objective  assessment  and  refer- 
ral, but  I  think  we  do  not  have  the  funds  to  be  as  all-encompassing 
as  expected.  I  do  not  disagree  with  the  goal  of  integration  of  serv- 
ices and  coordination  of  programs,  but  I  think  that  we,  as  a  system, 
are  being  asked  to  shoulder  responsibility  and  yet  there  are  no 
mandates  or  incentives  for  other  agencies  and  other  programs  to 
actively  participate  in  such  coordination. 

JTPA  would  benefit  from  more  defined  and  realistic  goals,  dif- 
ferentiation between  what  are  and  who  provides  short-term  and 
long-term  interventions,  and  better  articulation  among  the  ena- 
bling legislation  and  regulations  of  similar  programs  at  the  Federal 
level. 

In  general,  I  agree  with  my  colleagues  that  PIC's  should  avoid 
isolated  job  placement  programs  for  at-risk  youth  and  focus  on  the 
occupational  skills  model,  combining  skills  training,  academic  re- 
mediation, and  employability  skills  development. 

Make  no  mistake  about  it — a  program  such  as  JTPA  is  needed, 
and  successful  models  ought  to  be  adapted  to  local  conditions.  It  is 
needed  to  provide  a  second  chance  for  a  large  segment  of  our  popu- 
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lation  so  they  can  participate  in  the  economic  life  of  our  county,  our 
State,  our  country. 

It  is  also  needed  bv  employers  who  require  a  system  of  worker 
training  that  is  flexible  to  their  constantly  changing  demands.  A 
public/private  partnership,  as  utilized  by  JTPA,  is  also  needed. 
Whether  you  call  it  a  private  industry  council,  a  work  force  invest- 
ment board,  or  a  labor  market  board,  it  is  critical  to  institutionalize 
and  empower  such  a  partnership  to  rationally  and  effectively  plan 
how  an  area  spends  all  of  its  resources. 

I  thank  you  for  the  opportunity  of  testifying  today. 

[The  prepared  statement  of  Mr.  Zeller  follows:]  
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TESTIMONY  OF: 

John  Zeller 

Executive  Director 

Montgomery  County  Private  Industry  Council,  Inc. 

Montgomery  County,  Maryland 


BEFORE: 

U.S.  House  of  Representatives 

Committee  on  Government  Operations 

Subcommittee  on  Employment,  Housing  and  Aviation 


REGARDING: 

Effectiveness  of  JTPA  Title  IIA  in  Meeting 
the  Training  Needs  of  Disadvantaged  Adults  and  Youth 


1  My  name  is  John  Zeller  and  I  am  the  Executive  Director  of  the  Montgomery 

2  County,  Maryland  Private  Industry  Council.   Our  Private  Industry  Council  is  an  non- 

3  profit  corporation  that  took  over  the  Grant  Recipient  and  Administrative  Entity  status 

4  of  JTPA  as  of  July  1,  1992.    I  thank  the  Chair  for  the  invitation  to  address  the 

5  subcommittee  on  the  issue  of  JTPA. 

6  My  testimony  should  be  viewed  in  concert  with  that  of  my  colleague,  Jon 

7  Gerson.  As  Director  of  the  Office  of  Economic  Development,  Jon  has  spoken  of  the 

8  basis  for  the  recent  changes  in  our  County,  why  it  occurred,  and  where  we  are  in  the 

9  process    of    heading.       Montgomery    County   strongly    advocates    a    workforce 
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1  development  system  that  is  explicitly  linked  to  its  business  and  economic  life.    My 

2  testimony  focuses  on  the  implementation  of  these  efforts,  within  that  larger  context. 

3  The  question  of  what  works  and  what  does  not  can  be  dangerously  simplistic. 

4  Of  course  when  a  service  delivery  area  is  able  to  piece  together  that  constantly 

5  shifting  magical  combination  of  a  motivated  client  who  needs  the  services  you  best 

6  provide,   a   competent   service   provider   that    pulls   together   skills   training   with 

7  appropriate  pre-employment/life  skills  training  and  possibly  contextual  remediation, 

8  and  have  these  services  initially  driven  by  a  local  employer  who  has  a  need  for 

9  workers  and  has  articulated  that  need  to  you,  then  you  have  a  successful  program. 

10  I  posit  that  this  is  the  model  of  a  successful,  comprehensive  program.  Absent  one  of 

1 1  these  elements,  the  risk  of  failure  increases. 

1 2  The  reality  of  the  JTPA  system  is  that  we  work  with  many  more  people  than 

13  can  be  served;  all  of  whom  qualify  as  eligible  because  of  their  inability  to  financially 

14  sustain  themselves  without  relying  on  a  variety  of  government  assistance  programs. 

15  JTPA  is  serving  people  who  have  not  been  well  served  by  other  institutions.   Within 

16  that  universe  there  is  a  variety  of  levels  of  need  and  urgency.  For  people  with  a  solid 

17  work  history,  job  readiness  training  may  be  sufficient  to  attain  employment.   But  for 

1 8  most  economically  disadvantaged  clients  with  additional  barriers  to  employment,  skills 

19  training    is   essential.       This    skills   training    should    always    be    combined    with 

20  employabiiity/work  maturity  training.   Basic  education  as  well  as  ESL  should  also  be 

21  provided  at  the  same  time,  according  to  need. 

22  Our  Private  Industry  Council  consciously  strives  to  serve  in  an  equitable  fashion 
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1  those  segments  of  the  population  that  have  demonstrated  need.  In  the  middle  of  this 

2  current  program  year  in  all  titles  we  have  served  so  far  approximately  1 900  people  of 

3  whom  64%  are  female.  Half  of  our  population  is  African  American,  26%  Caucasian, 

4  14%  is  Hispanic  and  the  remaining  11  %  is  Asian.  These  numbers  reflect  the  growing 

5  diversity  of  Montgomery  County,  particularly  with  the  significant  recent  increase  in 

6  our  immigrant  population.  Our  cost  per  participant  averages  $1,200.00.  In  addition 

7  to  the  performance  standards  of  JTPA,  our  PIC  is  interested  in  how  we  have  helped 

8  the  community  by  linking  businesses  with  jobs  to  people  in  need  of  them,  career 

9  ladders,  and  longevity  of  employment. 

10  The  JTPA  Amendments  do  address  some  of  the  areas  of  concern  that  have 

1 1  come  to  light  over  the  past  number  of  years.  As  a  national  system,  I  believe  that  is 

12  good.  Unfortunately  it  tends  to  put  unnecessary  restrictions  on  jurisdictions  -  and  I 

13  include  the  State  of  Maryland  -that  have  been  doing  a  fair  and  honest  job.    As  an 

14  individual  responsible  for  operations  at  the  local  level,  I  believe  that  the  amendments 

15  have  oriented  us  in  much  more  of  an  assessment  and  referral  process  system  as 

16  opposed  to  an  outcome  oriented  system. 

1 7  The  JTPA  amendments  put  more  emphasis  on  serving  "at  risk  youth'  and  'hard 

18  to  serve'  or  'most  in  need'  adults,  legislating  the  proportion  of  such  targets  groups 

19  to  be  served.  This  directs  the  expenditure  of  JTPA  funds  to  the  most  needy  clients. 

20  The  objective  assessment  process  also  mandated  by  the  amendments  ensures  that 

21  candidates  are  properly  assessed  before  referring  them  to  an  employment  and  training 

22  program.  The  requirement  that  such  assessments  trigger  the  enrollment  of  applicants 
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1  into  the  PIC's  management  information  system,  and  the  development  of  an  Individual 

2  Service  Strategy  for  even  those  referred  to  another  organization  for  services,  places 

3  a  great  staff  resource  burden  on  PIC's  and  shifts  resources  away  from  clients 

4  determined  appropriate  for  JTPA  services.  Although  the  objective  assessment  process 

5  does  take  JTPA  closer  to  the  one  stop  shopping,  I  believe  that  proper  tracking  of  all 

6  applicants  assessed  by  this  process  should  be  done  without  formally  enrolling  clients 

7  into  the  MIS  system. 

8  Generally  this  emphasis  on  process  translates  into  more  paperwork  for  staff  to 

9  cope  with  and  fewer  dollars,  precious  dollars  at  that,  spent  on  actual  training  and 

10  client  programs.  I  fear  that  fewer  people  will  be  served  because  we  are  serving  more 

1 1  paper. 

1 2  Additionally,  due  to  the  procurement  procedures  that  will  be  instituted,  'off-the- 

13  shelf"  programs  will  pre-dominate  and,  smaller  non-profit  and  community  based 

14  organizations  will  have  a  more  difficult  time  participating  as  service  providers.  This 

1 5  would  be  unfortunate  because  it  is  entities  such  as  these  who  tend  to  be  the  most 

16  flexible  and  responsive  to  changing  labor  market  and  social  realities.   And  these  are 

17  the  kinds  of  services  that  need  to  be  procured. 

18  Mainly  I  fear  that  the  Amendments  may  set  up  the  JTPA  and  PIC  system  for 

19  failure  because  they  draw  resources  away  from  direct  training  and  support  services. 

20  In  discussion  with  my  colleagues,  there  is  a  sense  of  apprehension  that  the  language 

21  of  the  legislation  and  regulations  is  framed  in  terms  of  the  ideal  and  in  terms  of  the 

22  comprehensive.  The  reality  is  that  much  is  being  asked  with  insufficient  resource  and 
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1  authority.   I  do  not  disagree  with  the  goal  of  objective  assessment  and  referral,  but 

2  I  think  we  do  not  have  the  funds  to  be  as  all-encompassing  as  is  expected.  I  do  not 

3  disagree  with  the  goal  of  integration  of  services  and  coordination  of  programs,  but  I 

4  think  that  we  have  been  asked  to  shoulder  responsibility  and  yet  there  are  no 

5  mandates  or  incentives  for  other  agencies  and  programs  to  actively  participate  in  such 

6  coordination. 

7  Evaluation  studies,  such  as  the  report  of  the  Inspector  General  on  JTPA,  have 

8  generated  a  fair  amount  of  criticism.   I  am  torn  between  being  defensive  over  having 

9  the  shortcomings  of  the  system  pointed  out  (such  as  drop-out  rates,  low  wage  jobs. 

10  poor  grade-level  gains)  and  being  in  agreement  of  the  criticism.  I  believe  we  have  built 

11  in  an  inherent  dichotomy  between  the  hopes  and  expectations  of  working  with  people 

1 2  who  have  multiple  barriers  and  are  hard  to  serve,  and  yet  working  within  a  JTPA 

13  system  that  is  structured  and  evaluated  as  a  short-term  program.  JTPA  would  benefit 

14  from  more  defined  and  realistic  goals,  differentiation  between  what  are  and  who 

15  provides  short-term  and  long-term  interventions,  and  better  articulation  arrwng  the 

1 6  enabling  legislation  and  regulations  of  similar  programs  at  the  federal  level. 

17  Evaluation  studies  do  not  show  that  JTPA  does  not  work;  it  shows  that  there 

18  is  empirical  evidence  that  certain  program  designs  are  more  successful  than  others. 

19  The  practical  conclusion  for  PICs  is  not  that  JTPA  cannot  produce  unsubsidized  job 

20  placements  and  significant  job  retention,  but  that  those  models  which  have  succeeded 

21  for  similar  target  groups  ought  to  be  adopted.  The  National  Research  Council's  XfiUtb 

22  gmplovment  and  Training:    The  YEDPA  Years,  concludes  that  occupational  skills 
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1  programs  targeted  to  out  of  school  dropouts  'resulted  in  both  employment  and 

2  earnings  gains,  reduced  the  use  of  welfare  and  unemployment  insurance,  and 

3  decreased  criminal  activity".  There  was  no  evidence  presented  in  that  report  which 

4  shows  the  residential  component  to  be  essential  to  the  above  successful  outcomes. 

5  Job  placement  programs  for  youth  have  produced  only  short  term  increases  in  the 

6  rates  of  employment  and  earnings.  PICs  should  avoid  isolated  job  placement  programs 

7  for  at-risk  youth  and  focus  on  the  occupational  skills  model,  combining  skills  training, 

8  <     academic  remediation,  and  employability  skills  development. 

9  Make  no  mistake  about  it.  A  program  such  as  JTPA  is  needed  and  successful 

10  models  ought  to  be  adapted  to  local  conditions.    It  is  needed  to  provide  a  second 

1 1  chance  to  a  large  segment  of  our  population  so  they  can  participate  in  the  economic 

12  life  of  our  county,  state  and  country.   It  is  also  needed  by  employers  who  require  a 

13  system  of  worker  training  that  is  flexible  to  their  constantly  changing  demands.    A 

14  public/private  partnership,  as  utilized  by  JTPA,  is  also  needed.    Whether  one  calls 

15  them  private  industry  councils,  workforce  investment  boards  or  labor  market  boards, 

16  it  is  critical  to  institutionalize  and  empower  such  a  partnership  to  rationally  and 

17  effectively  plan  for  how  an  area  spends  its  resources. 

1 8  I  thank  the  Chair  and  the  subcommittee  for  the  honor  of  the  invitation  to  speak 

19  before  you  today. 
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Mr.  Peterson.  Thank  you  all.  This  discussion  we  had  earlier 
about  what  information  is  available,  I  assume  all  of  you  have  this 
information  available  that  they  claim  is  not  available  some  places. 
You  are  not  part  of  the  problem  there,  are  you?  You  can  tell,  at  any 
given  time,  how  much  you  have  invested  in  certain  people  and  all 
that  statistical  information? 

Mr.  Zeller.  I  would  say  in  general  that  we  have  systems  that, 
after  a  period  of  time — not  necessarily  easily— can  identify  the 
amount  of  resources  that  are  invested  in  an  individual,  and  we  can 
come  up  with  different  characteristics  like  that. 

Mr.  Peterson.  Did  you  all  develop  your  own  software  to  do  this, 
or  how  did  you  accomplish  it? 

Ms.  Irving.  It  has  evolved  over  the  years.  We  use  what  we  call 
a  participant  activity  tracking  system.  That  way,  we  can  track  all 
case  management  activities  and  counseling  as  well. 

As  I  mentioned  earlier,  we  use  competency  based  instruction  and 
we  pay  according  to  competencies.  We  like  performance-based  con- 
tracts, even  though  I  know  they  are  going,  but  we  still  use  work 
activity  plans.  We  really  want  to  know  how  the  client  is  progress- 
ing and  we  monitor  it  through  computerized  systems. 

Mr.  Peterson.  Did  you  develop  these  computer  programs  your- 
self? 

Ms.  Irving.  Yes,  we  did. 

Mr.  Peterson.  Did  you? 

Mr.  Struever.  Yes.  Our  biggest  issue,  when  you  talk  about  infor- 
mation systems,  as  we  have  struggled  through  the  management  in- 
formation systems  software  issues,  has  been  where  we  are  trying 
to  integrate  with  different  programs  and  agencies. 

I  think  Pat's  example  is  a  good  one,  with  a  welfare  employment 
program,  where  people  are  in  public  housing  and  can't  take  a  job 
without  pajdng  more  rent.  That  has  been  a  big  challenge  for  all  of 
us,  because  everybody  speaks  different  languages,  has  different 
definitions,  different  rules  that  they  have  to  follow.  I  think  by  and 
large,  we  have  made  a  lot  of  progress  with  that. 

One  of  the  problems  that  we  have  had,  as  an  example,  is  with 
tracking  people  through  schools  and  then  out  of  schools,  getting  in- 
formation out  of  school  systems,  so  that  the  job  training  system  can 
have  what  they  have  in  terms  of  confidentiality,  in  terms  of  being 
able  to  use  Social  Security  numbers. 

It  is  a  pretty  simple  system  through  the  unemployment  insur- 
ance to  be  able  to  track  aft.er  people  are  placed,  which  us 
businessfolk  on  the  PIC  are  very  interested  in.  That's  the  bottom 
line.  Do  they  get  a  job?  Do  they  stay  in  the  job?  Are  they  able  to 
earn  a  family  wage? 

One  of  the  thing  we  are  driving  to  is  to  get  some  better  systems 
to  get  beyond  the  kind  of  stuff  that  the  IG's  office  was  talking 
about  and  to  get  the  things  that  we  think  are  really  important. 

Mr.  Peterson.  But  specifically,  did  you  develop  your  own  soft- 
ware, too? 

Mr.  Struever.  The  city  of  Baltimore,  yes. 

Mr.  Zeller.  Our  management  information  system  basically  is 
something  that  has  been  developed  by  the  State  of  Maryland  that 
we  feed  into. 

Mr.  Peterson.  The  whole  State  has  it? 
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Mr.  Zeller.  Correct.  The  local  financial  accounting,  however,  has 
been  left  up  to  our  jurisdiction.  So  particularly  when  we  became  a 
corporate  entity,  we  developed  our  own  software  for  financial  track- 
ing. It  would  be  better  to  have  an  integrated  system  in  terms  of 
the  finances  and  MIS,  but  that  is,  I  think,  beyond  the  resources 
and  the  capability  that  we  have. 

Mr.  Peterson.  You  were  talking  about  the — at  some  point  I  was 
not  tracking  it  totally — about  intervening  at  the  eighth-grade  level 
or  something.  How  are  you  doing  that?  Are  you  in  the  school  sys- 
tem? 

Mr.  Struever.  Yes.  We  have  an  active  partnership  with  the  city 
schools.  It's  a  statewide  program,  Maryland's  tomorrow,  but  it's  a 
locally  managed  and  designed  program  in  each  jurisdiction  with 
each  PIC/SDA,  and  so  we  have  a  team  with  the  schools,  with  school 
department  employees,  funded  in  part  through  JTPA  funds  that 
pick  up  kids  coming  into  high  school  in  ninth  grade  and  then  rim 
year-aroimd  in-school  and  out-of-school  programs. 

Mr.  Peterson.  Why  do  you  have  to  tell  the  school?  Shouldn't 
they  know  that  they  should  teach  these  kids  how  to  read?  Why  do 
you  have  to  go  in  and  tell  them  that  they  have  to  learn  how  to 
read? 

Mr.  Struever.  Certainly  a  big  part  of  it  is  trying  to  figure  out 
better  ways — where  traditional  schooling  is  not  working  for  these 
kids  and  they  are  on  their  way  to  dropping  out — how  we  can  inter- 
vene with  some  kind  of  nontraditional  approaches  to  academics. 

Mr.  Peterson.  What  happened  here?  You  guys  were  all  together 
and  you  found  out  this  was  a  problem  and  so  you  sent  into  the 
school  system  and  said,  "Hey,  these  kids  can't  read  and  this  is  why 
they  can't  get  jobs  and  why  they  are  getting  into  all  this  trouble"? 

Mr.  Struever.  Yes. 

Mr.  Peterson.  So  you  developed,  with  the  schools,  some  kind  of 
way  to  try  to  get  at  this?  Is  that  what  happened? 

Mr.  Struever.  The  original  motivation  came  out  of  one,  employ- 
ers were  saying,  "The  jobs  are  available" — this  was  back  when 
things  were  booming  a  little  bit  better  in  the  mid- 1980' s — and  the 
applicants  did  not  have  the  skills,  so  that  the  PIC  was  getting  frus- 
trated in  that  they  could  not  place  people  because  they  were  not 
adequately  educated. 

Therefore,  we  were  getting  involved  with  the  schools.  We  had  the 
commonwealth  program  that  was  based  after  the  Boston  compact, 
which  was  a  series  of  graduation  incentives.  We  were  finding  that 
the  kids,  when  they  graduated,  either  did  not  have  the  skills  or, 
two,  they  were  not  graduating  at  all. 

Hence,  there  was  a  lot  of  pressure  to  get  in  with  the  school  sys- 
tems and  get  serious  about  keeping  these  kids  from  dropping  out 
and  making  sure  they  had  adequate  skills. 

Mr.  Peterson.  What  did  the  schools  say  about  this? 

Mr.  Struever.  The  partnership  has  been  a  positive  one, 
because 

Mr.  Peterson.  I  understand.  But  when  you  went  to  them  and 
said — I  mean,  weren't  they  working  on  this,  or  didn't  thev  care? 

Mr.  Struever.  To  some  extent  the  schools  have  welcomed  the 
help,  because  a  lot  of  the  problems  go  beyond  what  a  traditional 
school  can  do.  Summer  is  a  big  part  of  the  problem  for  these  kids. 
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Middle-class  kids  that  go  to  summer  camp  and  have  strong  fami- 
lies behind  them  over  the  summers,  they  don't  learn  as  fast  as  they 
do  during  the  school  year;  but  kids  from  city  schools  without  fami- 
lies, without  strong  neighborhoods  beyond  them,  lose  everything 
they  learned  during  the  school  year,  and  that  is  out  of  the  scope 
of  what  schools  can  do. 

Mr.  Peterson.  Why  is  that  out  of  the  scope?  They  could  have 
year-round  school.  They  could  go  to  school  from  8:00  to  5:00.  Why 
is  that  beyond  their  scope? 

Mr.  Struever.  Part  of  it  is  money  and  part  of  it  is — ^those  are 
all  very  fair  questions  to  ask. 

Mr.  Peterson.  They  say  that  it  will  take  less  money  if  you  oper- 
ate year  round.  In  Minnesota,  the  legislature  this  year  just  put  a 
proposal  on  the  table  to  go  to  a  12-month  school  year  and  extend 
the  day  to  try  to  deal  witn  some  of  these  other  issues.  Why  do  we 
have  some  other  program  outside  of  the  school  to  do  what  they 
ought  to  be  doing? 

Mr.  Struever.  This  program  is  not  outside  the  school.  I  think 
that  is  the  whole  point.  We  are  working  in  partnership  with 
schools.  To  run  a  year-round  school  system 

Mr.  Peterson.  I  understand,  but  it  comes  from  outside.  You  are 
not  on  the  school  board.  You  are  not  teaching  there. 

Mr.  Struever.  No,  but  the  superintendent  of  the  school  system 
is  on  the  PIC,  so  that  is  the  partnership  that  works.  So  we  run  a 
year-round  school  program,  de  facto,  for  these  kids  that  are  in  seri- 
ous trouble. 

Mr.  Peterson.  Is  that  the  best  way  to  do  things?  Wouldn't  it  be 
better  to  do  it  in  the  school? 

Mr.  Struever.  There  is  a  lot  of  effort  and  discussion  about 
school  reform,  which  is  an  exciting  thing.  I  think  that  JTPA  and 
PIC's  is  helping  lead  the  way  in  school  reform.  We  are  pushing  in 
the  right  direction. 

We  are  pushing  on  accountability  and  keeping  kids  in  school  that 
really  need  help  and  providing  these  kind  of  comprehensive  serv- 
ices, and  after  school,  and  working  with  the  families.  That  is  what 
we  are  working  toward. 

Mr.  Peterson.  I  did  not  hear  much  talk  about  how  you  interface, 
all  of  you,  with  the  higher  education  component  of  all  of  this — un- 
less I  wasn't  Hstening.  But  again,  that  is  something  else  that  some- 
what troubles  me.  The  higher  education,  vocational  schools  prob- 
ably are  not  training  people  for  the  jobs  that  are  actually  there. 
Are  you  also  involved  in  those 

Mr.  Struever.  Partnerships,  yes. 

Mr.  Peterson  [continuing].  Schools,  trying  to  get  the  jobs?  One 
of  the  things  you  talked  about  was  that  there  is  a  disconnect— that 
what  people  are  trained  for  is  not  necessarily  what  employers  need. 

My  judgment  is  that  some  of  the  problem  is  that  the  schools  are 
not  training  kids,  and  they  get  locked  into  these  programs  and  this 
turf,  and  they  don't  change  with  the  times.  Are  you  also  pushing 
people  in  that  area? 

Mr.  Zeller.  I  would  suggest  that  this  is  something  that  we  are 
moving  to,  that  we  see  that  it  could  be  the  local  and  higher  edu- 
cational institutions  as  larger  bureaucracies,  and  their  change  is 
much  slower.  In  effect,  the  JTPA  system,  I  think  has  been  asked 
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to  do  something  that  is  constantly  flexible,  that  is  like  a  rapid  re- 
sponse, and  our  measures  of  success  are  based  on  short-term 
tnings. 

I  believe  that  the  colleges  in  our  area  do  a  good  job,  but  they  are 
primarily  oriented  to  longer-term  programs.  We  can  feed  into  them 
to  a  certain  degree,  but  all  of  us,  I  think,  have  spoken  about  the 
end  product  as  jobs,  and  an  employer  and  job  opportunities  may 
exist  4,  5,  6  months  out,  and  you  have  to  prepare  people  in  a  much 
shorter  period  of  time. 

I  think  that  working  with  the  school  systems  more  carefully,  par- 
ticularly in  regard  to  the  other  programs  that  they  receive  from 
other  Federal  agencies — for  example,  the  Perkins  funding — ^we 
need  to  coordinate  more,  and  we  need  to  plan  together  more  up 
front. 

There  is  also  an  articulation  between  our  secondary  schools  and 
colleges  that  needs  to  be  part  of  this  equation,  too.  In  our  county, 
we  are  looking  at  the  "tech  prep"  program — in  the  last  2  years  of 
high  school  and  the  first  of  college  as  being  an  opportunity  to  do 
this. 

But,  from  the  JTPA  standpoint,  we  are  trying  to  inject  the  per- 
spective of  those  people  who  either  are  in  danger  of  aropping  out, 
in  danger  of  being  lost  by  the  system,  or  who  have  already  done 
so,  and  trying  to  bring  them  back  in.  That  is  the  example  that  I 
think  Bill  was  talking  about  with  the  State  of  Maryland's  initia- 
tive. It  is  an  example  of  the  comprehensive  program  that  is  in  the 
school  system. 

Most  of  it  is  funded  by  State  dollars,  not  JTPA,  JTPA  is  a  piece 
of  this.  But  we  are  trying  to  identify  people,  work  with  them  during 
the  4  years  of  high  school  and  1  year  after,  if  that  is  the  appro- 
priate transition,  either  to  work  or  postsecondary  education. 

Mr.  Gerson.  I'd  like  to  just  follow  up  with  one  comment  about 
your  question  because  it  is,  I  think,  a  good  one.  It  was  interesting 
to  me  to  speak  to  150  educators  from  our  local  school  system  re- 
cently, and  to  tell  them  about  what  we  were  doing  in  employment 
and  training  and  to  have  them  come  back  at  me  and  say,  "Our  job 
is  not  to  get  these  kids  jobs  or  prepare  them  for  jobs;  our  job  is  to 
educate  them.  Your  job  is  to  help  them  get  jobs." 

There  is  a  real  debate  going  on  about  whether  or  not,  indeed,  the 
iob  of  schools  is  to  educate  or  to  prepare  them  for  jobs.  Not  every- 
body is  on  board,  thinking  the  same  thing. 

Ms.  Irving.  I  have  to  agree  with  that.  That  is  what  we  are  seeing 
also,  that  we  educate  for  the  sake  of  educating  young  people.  The 
educational  system  doesn't  really  know  if  they  are  meeting  the 
needs  of  the  private  sector  or  the  corporations  or  not.  They  figure 
"Well,  if  we  have  been  doing  it  for  the  last  20  years,  why  fix  what 
is  not  broken?"  Well,  it  is  oroken.  Inner  cities  are  having  major 
problems,  far  beyond  anvthing  you  can  ever  imagine.  That  is  wlw 
we  try  to  support  the  school  district  as  much  as  we  can.  We  [PlCf] 
can  go  in  there — the  schools — and  make  a  difference  by  adding 
services. 

In  terms  of  the  colleges  and  universities,  what  I  see  is  an  adjust- 
ment on  their  part  to  realize  that  they  are  not  going  to  see  the  typ- 
ical academically  prepared  client;  and  they — colleges  and  univer- 
sities— have  to  shift  their  expectations  down  to  reality.  Then  they 
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are  going  to  have  to  work  harder  with  us  [PIC]  to  understand  the 
harder- to-serve  clients. 

We  see  ourselves  in  a  pivotal  spot  where  we  can  work  with  the 
universities  and  the  school  district  to  keep  peace. 

Mr.  Struever.  Your  question  about  higher  education  is  very  ap- 
propriate since,  if  we  are  working  toward  a  high-wage,  high-skill, 
high-performance  work  force  out  there,  that  higher  education  is 
definitely  a  big  part  of  that. 

One  specific  example,  I  think,  responds  to  the  kind  of  issues  that 
they  have  run  into  in  Montgomery  County.  Life  sciences  is  one  of 
Baltimore's  big  dreams  in  terms  of  its  economic  future,  and  we  are 
hearing  from  the  imiversities  and  research  institutions  and  busi- 
nesses there  is  this  big  gap  in  terms  of  skilled  lab  technicians. 

So  the  Baltimore  City  Community  College  now  has  life  sciences 
institute  that  does  lab  technicians'  training.  Then  they  found  that 
they  couldn't  get  kids  out  of  city  high  schools  that  would  qualify 
to  get  into  lab  technicians  training,  so  now  we  have  tech  prep  in 
the  high  schools  as  a  feeder  to  create  a  career  path,  now,  in  life 
sciences,  of  which  higher  education  and  the  K-to-12  system  and  the 
JTPA  system  are  all  intimately  entwined  together  in  trying  to 
make  that  all  happen. 

Mr.  Gerson.  And  as  different  as  Baltimore  and  Montgomery 
County,  MD  are,  and  to  give  some  sense  for  how  different  commu- 
nities are 

Mr.  Struever.  Yes,  they  have  all  the  money. 

Mr.  Gerson  [continuing].  We  produce  the  money  that  goes  to 
Baltimore.  [Laughter.] 

But  that  problem  is  one  that  is  common  to  our  own  community, 
as  well.  That's  why  I  was  talking  about  the  high-tech  firms  that, 
when  we  did  the  survey,  told  us  they  can't  find  entry  level  people 
to  do  these  jobs. 

Mr.  Peterson.  We  have  more  questions  we  have  to  ask.  Just  one 
final  comment.  I  represent  a  rural  area,  and  we  have  just  as  big 
problems  in  our  rural  areas  as  you  have  in  the  inner  city.  We  don't 
know  exactly  what  to  do  with  it  all,  either. 

We  appreciate  your  being  with  us  and  your  testimony  was  useful. 
We  may  submit  a  couple  or  three  questions  to  you  that  I  didn't  get 
a  chance  to  ask,  if  you  would  be  willing  to  answer  those,  and  we 
appreciate  you  taking  the  time. 

Ms.  Irving.  Thank  you  for  the  opportunity. 

Mr.  Zeller.  Thank  you. 

Mr.  Peterson.  I  would  like  to  call  the  last  panel.  We  have  David 
Williams,  who  is  the  Deputy  Assistant  Secretary  for  Employment 
and  Training.  He  is  accompanied  by  Karen  Greene,  chief  of  the  Di- 
vision of  Performance  Management  and  Evaluation;  Hugh  Davies, 
director.  Office  of  Employment  &  Training  Program;  and  Bryan 
Keilty,   administrator  of  Office   of  Financial   and  Administrative 

Management. 
Welcome  to  the  committee.  Again,  we  swear  everybody  in,  so  if 

you  don't  mind. 
[Witnesses  sworn.] 
Mr.  Peterson.  Thank  you.  Welcome  to  the  subcommittee. 
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STATEMENT  OF  DAVID  O.  WILLIAMS,  DEPUTY  ASSISTANT  SEC- 
RETARY, EMPLOYMENT  AND  TRAINING  ADMINISTRATION, 
DEPARTMENT  OF  LABOR,  ACCOMPANIED  BY  KAREN 
GREENE,  CHIEF,  DIVISION  OF  PERFORMANCE  MANAGE- 
MENT AND  EVALUATION;  HUGH  DAVIES,  DIRECTOR,  OFFICE 
OF  EMPLOYMENT  AND  TRAINING  PROGRAM;  BRYAN  KEILTY, 
ADMINISTRATOR,  OFFICE  OF  FINANCIAL  AND  ADMINISTRA- 
TIVE  MANAGEMENT;  AND  PATRICIA  WILKINSON,  GRANTS 
MANAGEMENT  SPECIALIST,  OFFICE  OF  GRANTS  AND  CON- 
TRACT MANAGEMENT 

Mr.  Williams.  Thank  you,  Mr.  Chairman.  I  would  Hke  to  take 
just  a  moment  to  also  introduce  to  you  Ms.  Pat  Wilkinson,  who  is 
from  our  Office  of  Grants  and  Contract  Management,  to  the  left  of 
Mr.  Keilty. 

Mr.  Keilty  has  been  overseeing  our  provisions  of  the  amendments 
that  deal  with  the  contracts,  management,  budget  and  some  of  the 
reporting  issues. 

Mr.  Hugh  Davies  has  spearheaded  our  effort  on  the  amendments 
process,  and  Karen  Greene  has  been  primarily  responsible  for  our 
evaluation,  research,  and  reporting  initiatives,  particularly  with  re- 
gard to  the  amendments. 

If  I  may,  Mr.  Chairman,  I  would  like  to  go  ahead  and  simply 
summarize  my  statement,  and  submit  the  full  statement  for  the 
record. 

Mr.  Peterson.  That  will  be  fine. 

Mr.  Williams.  I  am  pleased  at  this  opportunity  to  appear  at  the 
oversight  hearing  on  how  effectively  the  Job  Training  Partnership 
Title  II-A  Program  is  serving  disadvantaged  adults  and  youth.  I 
will  address  the  subjects  briefly  listed  in  your  letter  of  invitation, 
beginning  with  the  present  status  and  operations  of  the  JTPA  title 
II-A  program. 

Title  II-A  of  JTPA  is  the  largest  Federal  program  aimed  at  pro- 
viding job  training  for  the  poor.  $1.7  billion  is  presently  allotted  to 
the  50  States,  the  District  of  Columbia,  and  the  territories,  and  640 
local  service  delivery  areas  to  provide  job  training  to  economically 
disadvantaged  individuals.  From  1983,  when  the  II-A  program 
began,  through  June  1992,  programs  have  served  over  6  million 
adults  and  youth. 

JTPA  program  structure:  The  program  is  administered  through 
formula  grants  to  States  which,  in  turn,  presently  allocate  78  per- 
cent of  the  funds  by  formula  to  local  service  delivery  areas.  Gov- 
ernors have  the  basic  responsibility  for  program  oversight  and  set- 
ting administrative  standards. 

Local  programs  are  planned  and  monitored  by  the  private  indus- 
try councils.  They  are  selected  by  locally  elected  officials  and  they 
are  composed  of  a  majority  of  local  businessmen  and  business- 
women. 

A  State  job  training  coordination  council — which  includes  rep- 
resentatives of  business.  State  officials,  labor,  and  community  orga- 
nizations, as  well  as  others,  for  example,  from  health  and  welfare 
areas — advises  the  Governors  on  job  training  policy. 

There  are  an  estimated  16,000  service  delivery  staff  persons  na- 
tionally and  an  estimated  2,500  State  JTPA  staff  persons. 
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With  regard  to  local  program  activities,  they  provide  classroom 
training,  on-the-job  training,  basic  skills  instruction,  counseling,  job 
search  assistance,  and  supportive  services.  From  1983  to  1992,  over 
3.5  million  participants  were  placed  in  employment. 

Nearly  70  percent  of  the  adult  terminees  are  placed  in  jobs  and 
74  percent  of  the  youth  terminees  achieve  positive  terminations.  It 
may  be  increased  basic  skills,  it  may  be  a  return  to  school,  or  other 
positive  outcomes. 

These  are  program  year  1991  figures.  At  present,  participants  on 
average  were  enrolled  in  the  program  for  26  weeks.  I  believe  there 
was  testimony  earlier  indicating  about  18  weeks.  I  believe  that  pe- 
riod has  been  extended  and  the  period  of  time  remaining  in  the 
program  has  been  lengthened.  Likewise,  the  earnings  for  adults 
placed  has  moved  up  to  $6.08  an  hour  from  the  previous  figure  of 
about  $5.85. 

Over  60  percent  of  the  adults  were  employed  3  months  after  leav- 
ing the  program.  Minorities  make  up  more  than  half  of  the  pro- 
gram's participants;  and  nearly  one-third  were  members  of  families 
on  welfare. 

All  local  programs  are  operated  under  performance  standards 
specified  by  the  Secretan^  and  set  for  each  of  the  service  delivery 
areas  by  the  Governor.  Current  standards  include  adult  earnings, 
job  retention,  and  youth  positive  termination  rates,  such  as  return 
to  school  or  obtaining  new  skills. 

Job  training  reform  amendments:  Over  a  period  of  the  last  4 
years.  Congress  has  deliberated,  with  the  involvement  of  certainly 
the  career  staff,  the  GAO,  the  inspector  general's  office,  as  well  as 
others,  to  enact  the  Job  Training  Reform  Amendments  of  1992.  I 
will  comment  briefly  on  the  impact  of  the  amendments. 

We  believe  they  will  make  significant  changes  in  title  II-A, 
While  keeping  prior  aspects  of  the  program  involving  private  sector 
involvement,  a  performance-driven  system,  local  planning,  the 
amendments  make  some  significant  improvements,  we  believe. 

First  of  all,  we  realize  that  the  program  needed  more  targeting. 
Therefore,  we  believe  we  will  be  serving  more  of  those  most  in 
need,  in  both  adult  and  youth  programs.  All  of  these  people  are 
economically  disadvantaged  but,  under  the  amendments,  65  per- 
cent of  those  served  must  have  other  barriers  to  employment. 

We  are  going  to  continue  to  provide  client-centered  training. 
With  regard  to  that,  the  amendments  increase  those  requirements 
by  requiring  a  comprehensive  assessment  and  individual  service 
strategy.  You  heard  comments  on  that  earlier.  I  think  clearly  that 
is  what  the  amendments  drive  the  system  to  do,  to  assess  and  pro- 
vide individual  service  planning  strategies. 

Those  needing  only  job  search — and  we  talked  about  that  earlier 
in  the  day — will  be  directed  to  other  resources,  such  as  the  local 
employment  service  offices,  for  placement. 

Enhancing  the  coordination  of  JTPA  with  other  service  delivery 
activities  and  other  human  resources  activities  is  clearly  a  thrust 
of  the  amendments.  At  the  State  level,  there  is  a  new  human  re- 
sources investment  council  authorized,  providing  the  opportunity 
for  Governors  to  combine  planning  and  policy  direction. 

There  are  new  administrative  requirements.  All  costs  must  be  as- 
signed to  the  appropriate  cost  categories.  There  are  new  provisions 
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for  financial  management.  Specific  concerns  are  addressed,  with  re- 
gard to  selected  aspects  of  program  operations  such  as  limits  on 
program  income,  the  use  of  any  excess  income  or  so-called  profits, 
and  in  the  operation  of  the  on-the-job  training  program. 

There  is  a  new  standardized  program  information  reporting,  or 
SPIR,  system,  which  was  developed  in  conjunction  with  the  job 
training  amendments,  which  will  put  into  place  a  new  client  level 
reporting  system  for  all  terminees.  We  believe  that  is  a  unique  re- 
quirement amongst  Federal  programs. 

With  regard  to  implementation  of  the  amendments,  rulemaking 
was  begun,  even  before  the  amendments  were  enacted  in  Septem- 
ber 1992.  The  Department  published  an  advance  notice  of  rule- 
making in  the  "Federal  Register"  September  10  and  proceeded 
through  the  rulemaking  process  with  regard  to  the  interim  final 
rule,  which  was  signed  and  issued  on  December  17,  1992,  and  was 
published  in  the  "Federal  Register"  for  comments  on  December  29, 
1992. 

These  are  interim  final  rules  to  allow  the  system  to  operate. 
However,  we  are  now  in  the  process  of  reviewing  the  comments 
that  have  been  received  before  issuing  a  final  rule.  There  have 
been  more  than  400  comments  received.  It  will  probably  require 
that  we  take  until  September  1  to  review  and  issue  a  final  rule. 

With  regard  to  training,  we  have  provided  a  comprehensive,  4- 
day  training  course  to  the  system.  We  did  that  in  February  and 
March  of  this  year.  Prior  to  that,  we  had  also  provided  extensive 
training  on  procurement  throughout  the  country  to  the  system, 
both  State  and  service  delivery  levels.  The  States  in  turn,  right 
now  are  training  staff  in  their  local  service  delivery  areas. 

A  transition  schedule  and  instructions  have  been  issued  with 
specific  guidelines  indicating  how  we  transition  from  the  old  to  the 
new  system,  covering  such  things  as  assessment  and  also  the  use 
of  funds  during  the  transition  period. 

I  will  talk  a  little  about  the  effectiveness  of  the  JTPA  title  II- 
A  program  with  regard  to  the  studies  that  were  discussed  earlier. 

I  think  it  is  important  to  keep  in  mind  that  both  studies  were 
conducted  prior  to  the  1992  amendments.  We  believe  that,  as  Mr. 
Orr  testified  earlier,  the  national  JTPA  study  was  a  definitive  and 
scientific  one.  There  will  be  additional  information  coming  from 
that  study — reported  information  now  is  up  to  18  months.  There 
will  be  a  30-month  report  and  there  will  also  be  some  additional 
information,  I  believe,  on  cost  effectiveness. 

The  national  study  involved  more  than  20,000  JTPA  applicants 
in  16  SDA's.  It  followed  up  on  such  outcomes  as  employment,  earn- 
ings, and  educational  attainment.  At  the  18-month  followup,  as 
was  previously  indicated,  results  showed  positive,  modest  impacts 
for  both  adult  women  and  men.  It  showed  negative  results  for 
younger  people,  in  particular  for  young  males. 

It  did  indicate  that  there  was  some  progress  in  terms  of  achiev- 
ing a  GED  for  adults  who  entered  the  program,  as  high  school 
dropouts.  For  adult  women,  who  were  high  school  dropouts  when 
they  applied  to  JTPA,  19  percent  of  participants  versus  11  percent 
of  controls  achieved  a  GED  during  the  18-month  followup  period. 
For  adult  men  who  were  high  school  dropouts,  13  percent  of  par- 
ticipants were  7  percent  of  controls  achieved  a  GED  during  the  18- 
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month  period.  The  study  found  that  earnings  gains  were  7  percent 
for  adult  women  and  5  percent  for  adult  men  over  the  control 
group. 

The  results  of  the  national  study  for  youth  were  generally  dis- 
appointing. On  the  positive  side,  the  study  found  that  the  program 
almost  doubled  the  rate  of  attaining  a  GED — from  17  to  29  percent 
for  female  youth  and  from  14  to  24  percent  for  male  youth. 

However,  the  study  also  found  no  net  effect  on  earnings  at  18 
months  for  female  out-of-school  youth  and  actually  negative  effects 
for  earnings  of  out-of-school  male  youth.  The  negative  results,  as 
previously  indicated,  were  for  those  with  prior  arrest  records. 

The  national  study's  findings  are  useful  when  viewed  in  combina- 
tion with  other  net  impact  evaluations,  such  as  JOBSTART  and 
GET,  which  are  described  in  more  detail  in  the  fiill  statement. 

A  multiyear  evaluation  of  the  Job  Corps,  funded  by  the  Depart- 
ment and  completed  in  1982,  did  find  a  positive  benefit-cost  ratio 
of  $1.46  for  every  $1  spent  for  the  program  from  society's  point  of 
view.  It  found  post-program  gains  in  earnings  of  about  15  percent. 

I  should  indicate  that  the  amendments  envision  that  both  the 
full  assessment  and  individual  service  strategies  that  have  been 
used  successfully  in  the  Job  Corps  Program  will  now  be  required 
of  the  JTPA  title  II-A  program  in  general.  There  will  be  a  new  net 
impact  evaluation  of  the  Job  Corps  performed  shortly  and  that,  in 
fact,  should  g^ve  us  more  information  on  that  part  of  the  overall 
employment  and  training  situation. 

I  think  it  is  fair  to  say  that,  while  we  have  some  demonstration 
projects  which  have  given  us  information  on  how  better  to  serve 
disadvantaged  youth,  we  are  still  trying  to  find  ways  to  improve 
the  program.  We  are  looking  at  our  own  demonstration  projects;  at 
the  experience  of  the  Job  Corps.  The  experiments  in  some  of  these 
programs,  such  as  JOBSTART  and  the  CET  program  in  San  Jose, 
CA,  as  well  as  the  STEP  Program,  help  us  to  gain  more  informa- 
tion on  how  to  more  effectively  serve  youth. 

I  would  say,  with  regard  to  the  San  Jose  program,  that  one  thing 
that  we  did  find  was  that  the  use  of  basic  skills  training  as  well 
as  academic  enrichment,  as  well  as  positive  role  models  in  that  pro- 
gram, have  shown  significant  earnings  gains  for  young  people.  So 
this  is  one  area  in  which  we  are  continuing  to  follow  a  program  and 
hope  we  can  replicate  it  in  some  other  locations. 

The  Greneral  Accounting  Office  and  the  Department  of  Labor's 
Office  of  the  Inspector  General  have  examined  the  effectiveness  of 
JTPA.  You  heard  from  them  earlier.  With  regard  to  the  inspector 
general's  report,  we  believe  that  it  corroborates  many  of  the 
changes  and  the  need  for  changes  that  were  included  in  the  1992 
amendments  and  with  which  we  in  the  Department  worked  very 
closely  with  the  inspector  general's  office,  as  well  as  members  of 
Congress  and  their  staffs  over  a  significant  period  of  time  in  the 
last  3  or  4  years,  to  implement  the  1992  amendments. 

With  regard  to  the  future  of  the  JTPA  program,  it  is  clear  that 
JTPA  needs  to  be  more  closely  coordinated.  We  will  talk  a  little 
about  some  of  the  things  that  we  are  doing,  perhaps,  in  the  ques- 
tion and  answer  period. 

The  Secretary  is  currently  undertaking  a  review  of  all  the  Fed- 
eral job  training  programs,  including  JTPA,  to  determine  what  pro- 
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grams  and  strategies  work  and  those  which  do  not.  Clearly,  we  will 
continue  to  put  more  emphasis  on  those  programs  that  work  and 
reduce  those  that  have  proven  not  to  work. 

I  think  it  is  also  important  that  we  continue  to  work  with  the 
other  agencies  who  have  these  programs.  Again,  we  can  talk  a  little 
more  about  that.  We  have  some  interagency  agreements.  We  have 
some  task  force  groups  that  are  working  on  common  definitions 
and  on  common  plans  for  delivering  services.  We  will  be  glad  to  ac- 
cept your  suggestions,  and  work  with  this  committee  on  ways  to 
improve  these  progprams. 

This  concludes  my  prepared  statement.  I  will  be  pleased  to  an- 
swer any  questions,  Mr.  Chairman.  Thank  you. 

[The  prepared  statement  of  Mr.  Williams  follows:] 
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STATEMENT  OF 

DAVID  O.  WILLIAMS 

DEPUTY  ASSISTIVNT  SECRETARY 

EMPLOYMENT  AMD  TRAINING  ADMINISTRATION 

U.S.  DEPARTMENT  OF  LABOR 

BEFORE  THE 

SUBCOMMITTEE  ON  EMPLOYMENT,  HOUSING  AND  AVIATION 

COMMITTEE  ON  GOVERNMENT  OPERATIONS 

U.S.  HOUSE  OF  REPRESENTATIVES 

April  29,  1993 

Mr.  Chairman  and  Members  of  the  Subcommittee: 

I  am  pleased  to  have  this  opportunity  to  appear  at  this 
oversight  hearing  on  how  effectively  Job  Training  Partnership  Act 
Title  II-A  programs  are  serving  disadvantaged  adults  and  youth. 
I  will  briefly  address  the  subjects  listed  in  your  letter  of 
invitation,  beginning  with  the  present  status  and  operation  of 
JTPA  Title  II-A  programs. 

The  Job  Training  Partnership  Act  (JTPA)  was  enacted  in  1982. 
Title  II-A  of  JTPA  is  the  largest  federal  initiative  aimed  at 
providing  job  training  for  the  poor.   $1.7  billion  is  presently 
allotted  to  the  50  States,  the  District  of  Columbia,  and  the 
territories,  and  640  local  service  delivery  areas  (SDAs)  to 
provide  job  training  to  economically  disadvantaged  individuals. 
From  1983,  when  JTPA  Title  II-A  began  operations,  through  June  of 
1992,  local  Title  II-A  programs  have  served  over  6  million  adults 
and  youth. 
JTPA  Program  Structure 

The  JTPA  Title  II-A  program  is  administered  through  formula 
grants  to  States,  which  in  turn  presently  allocate  78%  of  the 
funds  by  formula  to  local  service  delivery  areas.   Governors  use 
the  balance  (22%)  for  administration  (5%),  education  coordination 
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activities  (8%),  older  worker  programs  (3%),  and  performance 
incentives  and  technical  assistance  (6%) .   Governors  have  the 
basic  responsibility  for  program  oversight  and  setting 
administrative  standards  for  the  program.    Local  programs  are 
planned  and  monitored  by  Private  Industry  Councils  (PICs)  which 
are  selected  by  local  elected  officials  and  made  up  of  a  majority 
of  local  businessmen  and  women.   Nearly  8,000  businessmen  and 
women  serve  on  PICs.   A  State  Job  Training  Coordination  Council, 
which  includes  representatives  of  business,  State  officials, 
labor  and  community  organizations,  and  others,  advises  the 
Governor  on  job  training  policy. 

The  average  SDA  staff  size  is  25,  and  there  are  an  estimated 
16,000  SDA  staff  persons  nationally.   Seventy  percent  of  SDA 
staff  earned  less  than  $25,000  in  1987.   The  average  State  staff 
for  JTPA  programs  is  44,  and  there  are  an  estimated  2,500  State 
JTPA  staff  persons  nationally.   A  majority  of  both  State  and  SDA 
staff  have  substantial  experience  in  their  current  position  and 
within  the  employment  and  training  field. 
Local  Program  Activities  ' 

Local  programs  provide  classroom  training,  on-the-job 
training,  basic  skills  instruction,  counseling,  job  search 
assistance  and  supportive  services  to  participants.   From  1983  to 
1992,  over  3.5  million  participants  were  placed  in  employment. 
Nearly  70%  of  the  adult  terminees  are  placed  in  jobs  and  74%  of 
the  youth  terminees  achieve  positive  terminations  —  placement  in 
jobs,  return  to  school,  further  training,  etc.   For  the  most 
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recent  year  of  operation  (July  1,  1991  -  June  30,  1992), 
participants  on  average  were  enrolled  in  the  program  for  26 
weeks.   Adults  were  placed  in  jobs  with  an  average  wage  of  $6.08 
per  hour,  with  over  60  %  of  them  employed  three  months  after 
leaving  the  program.   Minorities  made  up  more  than  half  of  the 
program's  participants,  and  nearly  one-third  were  members  of 
families  on  welfare. 
A  Performance  Driven  System 

All  local  JTPA  programs  are  operated  under  performance 
standards  which  are  specified  by  the  Secretary  of  Labor  and  set 
for  each  service  delivery  area  by  the  Governor.   Current 
standards  include  adult  earnings  and  job  retention  rates  and 
youth  positive  termination  rates.   If  local  areas  exceed  the 
standards,  they  receive  from  the  Governor  a  proportionate  share 
of  incentive  funds.   If  they  fail  to  meet  the  standards,  they 
receive  technical  assistance  to  improve  performance,  or  if  they 
fail  for  two  consecutive  years  sanctions  are  applied. 
The  Job  Training  Reform  Amendments  of  1992 

Your  letter  asked  me  to  discuss  the  anticipated  impact  of 
the  1992  amendments  to  the  Act,  as  well  as  a  report  on  the  status 
of  the  Department's  implementation  of  the  amendments. 
The  Basis  for  the  Amendments 

As  early  as  1987,  certain  issues  arose  regarding  the 
operation  of  JTPA,  and  in  particular  Title  II-A: 

o    Was  the  program  serving  those  eligible  participants  who 
were  most  in  need,  or  was  the  program  serving  those 
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most  readily  placeable? 

o    What  was  the  quality  and  sufficiency  of  the  training 
and  services  provided  by  JTPA? 

o    Was  the  arrangement  for  program  administration,  largely 
delegated  to  the  Governors,  working  acceptably? 

The  discussion  of  these  issues  formed  the  basis  for  a  major 
policy  debate  on  JTPA.   An  Advisory  Committee  was  commissioned  to 
make  recommendations  on  the  redirection  of  JTPA.   The  General 
Accounting  Office  and  the  Department's  Office  of  the  Inspector 
General  also  provided  critical  review  of  these  issues.   Over  a 
period  of  four  years,  Congress  considered  legislation  to  revise 
JTPA.   The  culmination  of  these  efforts  was  the  enactment  of  the 
Job  Training  Reform  Amendments  of  1992. 
The  Impact  of  the  Amendments 

The  Amendments  will  make  significant  changes  in  the  quality, 
delivery,  and  administration  of  programs  under  JTPA  Title  II-A. 
While  keeping  the  aspects  of  the  program  which  have  been  the 
cornerstones  of  JTPA,  such  as  private  sector  involvement,  a 
performance  driven  system,  and  local  planning,  the  Amendments 
will  make  major  improvements  in  the  following  areas: 

1)  Reaching  those  most  in  need  -  Both  adult  and  youth 
programs  must  still  serve  individuals  who  are  economically 
disadvantaged,  but  now  65%  of  those  served  must  have  other 
barriers  to  employment,  such  as  being  a  welfare  recipient,  basic 
skills  deficient,  a  school  dropout,  a  person  with  disabilities, 
an  offender,  or  homeless.   This  will  ensure  that  JTPA  services 
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are  targeted  to  those  who  are  most  in  need  and  can  benefit  from 
job  training. 

2)  Providing  client  centered  training  -  All  participants 
must  receive  a  comprehensive  assessment  of  their  skill  levels  and 
service  needs,  and  have  an  individual  service  strategy  based  on 
the  assessment.   Local  programs  must  provide  an  array  of  training 
and  services  which  will  respond  to  the  needs  of  the  participants. 
It  is  expected  that  only  those  participants  needing  job  training 
will  be  enrolled.   Those  needing  only  job  search  will  be  directed 
to  other  resources  in  the  community.   At  least  half  of  the  funds 
going  to  local  communities  must  be  spent  for  training,  and  up  to 
30  percent  of  the  funds  may  be  spent  for  supportive  services  or 
training  related  expenses.   No  more  than  20  percent  may  be  spent 
for  administration.   This  revamping  of  the  basic  service  design 
in  JTPA  II-A  is  expected  to  substantially  improve  the  quality  of 
training  and  the  overall  performance  and  impact  of  the  program. 

3)  Enhancing  the  coordination  of  JTPA  with  other  human 
service  activities  -  The  Amendments  provide  for  greater 
coordination  of  JTPA  with  other  hviman  service  programs  in  local 
communities  and  at  the  State  level  -  such  as  JOBS,  Vocational 
Education,  Adult  Basic  Education,  and  others.   New  requirements 
emphasize  coordination  in  local  planning.   New  arrangements  are 
established  for  education  coordination  activities.   A  new  State 
level  human  resource  investment  council  is  authorized,  providing 
the  opportunity  for  Governors  to  combine  the  planning  and  policy 
direction  of  several  human  service  programs  administered  at  the 
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State  level.   Over  20  States  are  expected  to  establish  such 
councils. 

4)  New  administrative  arrangements  are  required  -  The 
administrative  concerns  identified  in  JTPA  are  addressed  in  the 
Amendments.   The  Secretary  will  specify  the  basic  procurement 
provisions  which  must  be  included  in  all  Governor's  policies. 
All  costs  must  be  assigned  to  the  appropriate  cost  categories. 
New  provisions  for  financial  management  are  to  be  applied. 
Specific  concerns  with  selected  aspects  of  program  operation  are 
addressed  -  such  as  limits  on  program  income,  profits,  and  the 
operation  of  on-the-job  training  programs.   ETA  has  taken  action 
on  certain  of  these  areas  already.   Systemwide  monitoring  of 
procurement  and  on-the-job  training  has  already  occurred,  and 
where  deficiencies  have  been  identified,  corrective  action  has 
been  taken. 

5)  Standardized  Program  Information  Reporting  -  A  new 
Standardized  Program  Information  Reporting  (SPIR)  system,  which 
was  developed  in  conjunction  with  the  Job  Training  Reform 
Amendments,  will  put  in  place  a  new  client-level  data  system  for 
JTPA  that  is  unique  among  Federal  programs.   This  new  system, 
which  becomes  effective  this  July,  will  provide  comprehensive 
data  on  all  JTPA  clients  —  their  characteristics,  the  services 
they  receive,  and  outcomes  —  that  can  be  used  by  policymakers 
and  managers  at  the  Federal,  State,  and  local  levels. 
Implementing  the  Amendments 

1)  Rulemaking  -  The  Job  Training  Reform  Amendments  were 


201 


7 
enacted  on  September  7,  1992.  The  Department  published  an  advance 
notice  of  proposed  rulemaking  in  the  Federal  Register  on 
September  10  requesting  comments  on  the  principal  issues 
anticipated  in  rulemaking  and  implementation.   The  comments 
received  and  the  active  collaboration  of  ETA  with  system 
representatives  and  staff  of  the  Office  of  the  Inspector  General 
formed  the  basis  for  the  Interim  Final  Rule  signed  on  December 
17,  1992  and  published  in  the  Federal  Register  on  December  29. 
To  date  over  400  comments  have  been  received  on  the  rule.   In 
order  to  carefully  analyze  this  large  volume  of  comments,  the 
Department  has  delayed  the  publication  date  of  the  final  rule 
from  June  1  until  September  1. 

2)  Training  -  The  Department  provided  comprehensive,  four- 
day  training  sessions  on  Amendment  and  regulatory  requirements  to 
a  core  group  of  State  officials  in  February  and  March  of  1993. 
The  States,  in  turn,  are  training  staff  of  their  local  service 
delivery  areas.   The  Department  is  also  providing  further 
specific  training  during  the  next  six  months  on  key  aspects  of 
the  amendments  such  as  assessment,  youth  service  strategies,  and 
financial  management.   All  training  is  being  undertaken  with  the 
support  and  collaboration  the  OIG  and  other  Department  agencies. 

3)  Transition  Schedule  and  Instructions  -  ETA  has  issued 
specific  guidelines  to  the  JTPA  system  which  provide  information 
on  the  transition  from  the  old  program  requirements  to  those 
required  in  the  Amendments.   The  effective  date  is  July  1,  1993. 
Guidance  has  been  provided  on  the  application  of  new 
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requirements,  including  the  use  of  carry-in  funds  and  the  phasing 
in  of  certain  requirements  during  Program  Year  (PY)  1993  (the  one 
year  period  following  July  1,  1993) .   All  administrative  rules 
are  to  take  effect  July  1.   Certain  program  design  areas  are  to 
be  phased  in  during  PY  93  in  order  to  ensure  their  effective 
implementation.   These  include  new  assessment  systems  and  out-of- 
school  youth  service  requirements. 
Effectiveness  of  JTPA  Title  II-A 

Mr.  Chairman,  next  I  will  discuss  the  effectiveness  of  JTPA 
Title  II-A  programs.   Please  keep  in  mind  that  each  of  the 
studies  I  will  refer  to  was  of  the  JTPA  program  prior  to  the  1992 
amendments.   While  there  have  been  many  studies  and  evaluations 
of  JTPA,  we  believe  the  most  definitive  and  scientific  is  our 
National  JTPA  study.   This  net  impact  evaluation  is  a  random 
assignment  study.   Preogram  applicants  are  divided  into  treatment 
and  control  groups  through  a  lottery.   Control  groups  are  denied 
job  training  services  from  the  particular  program  under  study  to 
establish  what  would  happen  in  the  absence  of  the  program.   The 
National  JTPA  Study  randomly  assigned  20,000  JTPA  applicants  in 
16  SDAs  to  treatment  and  control  groups  over  the  period  November 
1987  through  September  1989.   However,  it  should  be  noted  that 
the  SDAs  themselves  were  not  randomly  selected  and  are  not 
necessarily  representative  of  all  SDAs.   Individuals  in  the 
treatment  and  control  group  are  followed  up  over  time  to 
determine  if  the  training  had  an  impact  on  post-program  outcomes 
such  as  employment,  earnings,  and  educational  attainment.    The 
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measurement  of  the  difference  in  employment  and  earnings  between 
the  treatment  and  control  groups  is  the  net  impact. 

At  eighteen  months  followup,  the  study  found  positive  but 
generally  modest  net  impacts  for  adults.   On  average,  compared  to 
controls,  the  program  nearly  doubled  the  rate  of  attaining  a  GED 
for  adults  who  entered  the  program  as  school  dropouts — from  11  to 
19  percent  for  women  and  from  7  to  13  percent  for  men.   The  study 
also  found  earnings  gains  over  controls  of  7  percent  for  adult 
women  assigned  to  the  program  and  5  percent  for  adult  men 
assignees  during  the  18-month  period  following  random  assignment. 
Earnings  gains  for  women  were  found  in  both  classroom  training 
and  on-the-job  training  (OJT) ,  while  gains  for  men  were 
concentrated  in  OJT.   These  positive  gains  appear  to  be  holding 
steady  over  time,  and  will  be  re-examined  at  30  months  follow-up. 

The  study  also  looked  at  the  issue  of  whether  training  was 
more  effective  for  the  most  job-ready  or  least  job-ready.   It 
found  that,  for  adults,  the  most  job-ready  had  the  best  results, 
which  suggests  the  need  for  more  comprehensive  interventions  for 
the  least  job-ready. 

These  findings  for  adults  are  consistent  with  the  major 
studies  of  welfare-to-work  programs,  which  have  found  modest  but 
positive  gains  for  adults. 

The  results  of  the  National  JTPA  Study  for  youth  were 
generally  disappointing.   On  the  positive  side,  the  study  found 
that  the  program  almost  doubled  the  rate  of  attaining  a  GED  for 
youth  who  entered  the  program  as  school  dropouts — from  17  to  29 
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percent  for  female  youth  and  from  14  to  2  4  percent  for  male 
youth.   However,  the  study  also  found  no  net  effect  on  earnings 
18-months  after  random  assignment  for  female  out-of-school  youth 
and  negative  net  effects  on  earnings  for  out-of-school  male 
youth.   The  negative  results  for  male  youth  were  concentrated 
among  those  with  prior  arrest  records  (25  percent  of  the  sample) , 
but  even  for  male  youth  without  records  the  program  did  not 
achieve  positive  impacts. 

Many  of  the  National  Study's  findings  are  corroborated  by 
other  net  impact  evaluations  of  particular  programs  and  models. 
For  example,  a  JOBSTART  demonstration  funded  in  part  by  the 
Department  of  Labor  attempted  to  provide  a  fairly  comprehensive 
set  of  basic  skills  and  vocational  skills  to  dropout  youth  with 
low  reading  skills.   The  evaluation  has  found  positive  impacts  on 
achieving  a  GED.   However,  the  evaluation  has  found  only  modest 
net  impacts  on  earnings  for  female  youth,  and  negative  impacts 
for  male  youth  during  the  first  two  years  of  follow-up  balanced 
by  positive  impacts  during  the  third  and  fourth  year  of  follow- 
up.   The  JOBSTART  cumulative  four-year  results  for  males  are 
still  slightly  negative,  but  the  third  and  fourth  year  gains 
suggest  that  early  losses  in  earnings  may  be  made  up  over  time 
and  that  educational  gains  from  the  program  may  be  beginning  to 
have  some  effect.   The  JOBSTART  results  are  particularly 
important  because  the  demonstration  in  many  ways  reflects  the 
direction  in  which  DOL  and  Congress  has  been  pushing  JTPA — 
towards  more  comprehensive  services  to  more  at-risk  persons. 
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One  JOBSTART  site  —  the  CET  program  in  San  Jose,  California 
—  had  very  positive  results.   This  same  program  also  had  very 
positive  earnings  gains  in  a  separate  demonstration  aimed  at 
minority  female  single  parents.   The  CET  program  is  quite 
structured  and  offers  concurrent  basic  education  and  job 
training,  with  close  interaction  with  case  managers  and 
instructors  with  extensive  industry  experience. 

A  multi-year  evaluation  of  the  Job  Corps  funded  by  the 
Department  and  completed  in  1982  did  find  a  positive  benefit-cost 
ratio  of  $1.46  per  $1  spent  for  the  program  from  society's  point 
of  view.   The  study  found  post-program  gains  in  earnings  of  about 
15  percent,  but  much  of  what  tipped  the  scale  in  favor  of  a 
positive  benefit-cost  ratio  were  savings  in  criminal  justice 
costs  due  to  reduced  serious  crimes  committed  by  participants — 
both  while  they  were  in  the  program  and  fewer  serious  crimes 
committed  after  they  left.   The  study  used  a  comparison  group 
rather  than  a  control  group  design.   The  Department  is  currently 
competing  a  net  impact  evaluation  of  the  Job  Corps. 

Overall,  these  findings  indicate  that  we  do  not  yet  have  the 
answers  for  effectively  serving  disadvantaged  youth.   We  are 
trying  to  work  towards  these  answers.   For  example,  we  might  be 
more  successful  if  we  caught  youth  earlier,  before  they  left 
school  —  suggesting  the  need  to  better  integrate  our  programs 
with  the  public  schools,  as  we  are  proposing  to  do  with  our 
school -to-work  transition  initiative.   This  initiative  will 
provide  students  with  structured  career  paths  and  afford  students 
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the  opportunity  to  learn  in  "real  world"  contexts,  such  as 
worksites  and  communities,  as  well  as  classrooms.   We  also  might 
be  more  successful  with  a  tightly  targeted  geographic  saturation 
of  program  alternatives,  as  we  are  doing  in  our  Youth  Fair  Chance 
program.   Peer  pressure  is  perhaps  the  dominant  force  that  acts 
on  youth,  and  a  saturation  of  programs  may  be  necessary  to 
reverse  the  negative  peer  pressure  that  in  many  cases  now 
prevails  among  disadvantaged  youth. 

The  General  Accounting  Office  (GAO)  and  the  Department  of 
Labor's  Office  of  the  Inspector  General  (OIG)  also  have  examined 
the  effectiveness  of  JTPA.   Many  of  the  findings  of  the  GAO 
formed  the  basis  for  modifications  to  the  current  program  that 
were  included  in  the  Job  Training  Reform  Amendments  of  1992.   The 
recent  OIG  report  on  JTPA  program  outcomes  in  3  5  Service  Delivery 
Areas  is  useful  in  that  it  corroborates  the  need  for  many  of  the 
changes  that  were  included  in  the  1992  Amendments.   Like  the 
other  studies,  however,  the  OIG  report  refers  to  the  program 
prior  to  the  implementation  of  the  1992  amendments. 
The  Future  of  JTPA  -  " 

Finally,  Mr.  Chairman,  you  asked  that  I  address  a  series  of 
questions  relating  to  the  future  of  the  JTPA  program,  such  as 
whether  JTPA  should  be  integrated  with  other  job  training 
programs,  how  it  fits  into  the  Department's  strategy  for  creating 
a  competitive  workforce,  and  how  Federal  job  training  funds  can 
be  best  utilized.   Secretary  Reich  is  undertaking  a  review  of 
Federal  job  training  programs,  including  JTPA,  to  determine  the 
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programs  and  strategies  that  work  and  those  that  don't.   We  need 
to  put  more  of  our  resources  into  the  former  and  phase  out  the 
approacl^fe  that  are  ineffective.   You  can  be  assured  that  tlwP 
Department  will  be  having  many  discussions  with  this 
Subcommittee,  as  well  as  the  authorizing  Committee,  as  our  review 
progresses.   We  welcome  your  suggestions,  as  well  as  those  of  the 
GAO,  the  OIG,  and  others,  for  ways  to  improve  our  Nation's  job 
training  programs. 

Mr.  Chairman,  this  concludes  my  prepared  statement.  At  this 
time  I  would  be  pleased  to  answer  any  questions  that  you  or  other 
members  of  the  Subcommittee  may  have. 
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Mr.  Peterson.  Thank  you,  Mr.  Williams.  Nobody  has  been  ap- 
pointed over  at  your  shop  yet? 

Mr.  Williams.  Mr.  Douglas  David  Ross's  nomination  has  gone 
forward,  sir,  and  we  are  waiting  for  that  process  to  be  completed. 

Mr.  Peterson.  He  will  be  whatever  the  title  is  over  your  Depart- 
ment? 

Mr.  Williams.  Assistant  Secretary  for  Employment  and  Train- 
ing, sir. 

Mr.  Peterson.  What  do  you  say  about  the  discussion  that  we 
had  earlier  about  the  fact  that  the  IG  said  that  they  don't  know, 
they  can't  measure  these  programs  from  some  areas  and  they  don't 
have  the  information? 

Mr.  WlLLL\MS.  Well,  first  of  all,  I  would  ask  that  Ms.  Greene  talk 
a  little  about  what  we  do  have  in  place.  In  particular,  we  have  a 
performance  measurement  system  that  has  been  in  place  for  some 
period  of  time  which,  in  fact,  drives  this  system  in  terms  of  incen- 
tive payments  and  awards  that  are  made,  recognition  for  exem- 
plary programs,  and  sets  standards  for  the  system  which,  in  turn, 
are  reviewed  and  set  for  each  service  delivery  area. 

I  would  like  you  to  talk  first  about  that  system  a  little,  Karen, 
if  you  would,  in  terms  of  both  providing  information  about  the  pro- 

fram  and  then  driving  the  system  in  terms  of  performance  in  the 
irection  to  serve  more  of  those  who  are  hard  to  serve  and  includ- 
ing welfare  recipients  and  others. 

Ms.  Greene.  I  will  just  take  a  short  period.  We  have  six  meas- 
ures that  we  use  in  order  to  assess  program  performance,  and  they 
are  absolutely  unique,  as  far  as  I  know  right  now,  to  any  Federal 
program. 

We  look  at  whether  individuals  are  employed  and  what  their 
earnings  are  13  weeks  after  they  leave  the  program.  We  not  only 
collect  information  on  those  participants  while  they  are  in  the  pro- 
gram but  every  person  that  you  saw  sitting  at  this  table  earlier  has 
a  responsibility  to  conduct  telephone  followups  to  find  out  if  they 
are  employed. 

We  have  a  record  of  61  percent  of  our  adults  still  working  13 
weeks  after  they  leave  the  program.  Fifty  percent  of  our  welfare  re- 
cipients still  have  jobs  and  are  working  13  weeks  after  they  leave 
the  program.  We  also  collect  information  on  the  earnings  of  those 
individuals. 

For  youth,  because  so  many  of  those  are  in  school  and  are  not, 
perhaps,  able  to  work,  we  collect  information,  as  was  mentioned  in 
the  previous  testimony,  about  other  factors  that  measure  their  em- 
ployability,  their  occupational  and  basic  skill  achievement;  but 
these  would  be  achievements  short  of  a  job. 

We  have  been  reviewing  our  standards,  stalling  oft"  early  on  with 
short-term  standards.  Because  of  some  of  the  effects  that  perform- 
ance standards  have  had  on  the  program,  we  have  altered  them  pe- 
riodically and,  right  now,  they  are  totally  in  sync  with  the  depart- 
mental goals. 

I  think  one  of  the  concerns  that  we  have  had  in  the  Department 
is  making  sure  that,  as  you  set  numerical  goals  and  targets  for  pro- 
grams, that  you  don't  create  a  situation  where  they're  working  so 
hard  in  order  to  make  numbers  to  document  their  success  that 
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they,  in  turn,  lose  sight  of  the  dients  that  they  are  supposed  to 
serve  and  the  way  they  are  serving  them. 

So  we  have  had  to  make  adjustments  over  time  to  do  that  so  that 
we  would  avoid  a  preoccupation  with  serving  more  job  ready  and, 
perhaps,  providing  less  effective  less-intensive  services  in  order  to 
keep  costs  down;  giving  the  appearance  of  efficiency  at,  perhaps, 
the  sacrifice  of  our  clients. 

So  in  terms  of  our  performance  management  system,  we  are  con- 
stantly reviewing  it  and  constantly  gettmg  feedback  from  the  field 
on  what  the  implications  are  of  our  performance  management  sys- 
tem on  enrollment  policies,  service  delivery,  and  other  operational 
effects  for  our  clients. 

Mr.  Peterson.  I  wasn't  probably  clear  enough,  but  what  I  want 
to  know  is,  it  says  here,  "Determining  the  total  investment  for  each 
participant  was  impossible."  Do  you  agree  with  that? 

Mr.  Williams.  I  think,  in  part,  the  performance  measures  an- 
swer one  part  of  that.  I  think  the  new  standardized  reporting  sys- 
tem which  will  give  individual  client 

Mr.  Peterson.  We  are  not  talking  about  performance  here,  we 
are  talking  about  investment — dollars — ^from  what  I  understand. 

Mr.  Davies.  Clearly,  we  have  data  on  cost  per  entered  employ- 
ment, so  we  know  how  much  it  costs  to  achieve  the  standard  pro- 
gram outcome. 

Mr.  Peterson.  Why  does  he  say  this?  Why  did  he  say  determin- 
ing the  total  investment  was  impossible? 

Mr.  Davies.  I'm  not  sure,  but  I  can  assure  you  that  we  have  spe- 
cific data  on  the  expenditures  in  the  program  and  how  much  it 
costs  for  each  individual  positive  outcome. 

Mr.  Peterson.  What  does  that  mean?  For  the  no  positive  out- 
comes you  don't  have  that,  or  what? 

Mr.  Davies.  We  have  full  data  on  the  outcomes  for  all  the  par- 
ticipants. We  have  fiill  information  on  the  expenditures  in  the  pro- 
gram. 

Mr.  Peterson.  These  SDA's  and  whoever  they  are,  the  States, 
they  give  you  this  information? 

Mr.  Davies.  That's  right.  We  get  the  information  reported  from 
each  of  the  service  delivery  areas  and  we  get  expenditure  informa- 
tion from  the  States  on  the  total  expenditures  in  that  State. 

Ms.  Greene.  I  think  one  thing  that  we  cannot  do  is  we  cannot 
measure  the  total  costs  that  are  involved  in  bringing  a  client  up 
to  a  fully  employable  State. 

There  was  a  reference  made  this  morning  that  there  is  a  lot  of 
leveraging  of  resources.  When  you  are  serving  a  hard-to-serve  cli- 
ent, you  are  perhaps  pulling  resources  from  vocational  education, 
welfare,  federally  funded  programs  like  the  JOBS  programs.  You 
could  have  State  moneys;  you  can  have  local  moneys. 

There  are  a  lot  of  resources  that  go  into  running  the  programs. 
In  the  case  of  Baltimore  for  example,  they  ticked  off  a,  number  of 
partnerships  and  made  reference  to  many,  many  service  providers 
and  funding  resources  contributing  to  the  success  of  those  clients 
who  went  through  JTPA. 

We  can  do  a  fairly  good  job,  I  think,  and  are  trying  to  work  on 
tracking  what  the  costs  are  for  the  total  number  of  participants 
that  go  through  the  program.  But  to  be  able  to  find  out  how  many 
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other  resources  contributed  to  that  individual  from  these  other 
sources  is  very  difficult. 

Mr.  Peterson.  I  can  understand  that.  But  it  says  here:  "Finan- 
cial records  were  usually  not  maintained  on  a  participant  basis." 

Ms.  Greene.  They  don't  normally  collect  costs.  They  can't  sepa- 
rate out  costs  by  individual. 

Mr.  Peterson.  That's  not  true.  I  was  at  my  CEP  agency,  and 
they  absolutely  have  this  every  single  day.  They  have  more  stuff 
than  you  could  ever  know  what  to  do  with.  So  why  do  they  say  that 
they  were  not  maintained?  Do  you  know? 

Ms.  Greene.  From  my  knowledge  of  the  accounting  systems  at 
the  local  level,  it  is  very  difficult  to  be  able  to  attribute  specific 
costs  for  that  individual  if  there  is  more  than  one  funding  source 
that  is  being  used  to  serve  that  individual. 

Mr.  Peterson.  That's  not  true  in  the  agency  that  is  in  my  home 
town. 

Ms.  Greene.  Some  do,  but  I  think  in  the  sites — they  were  refer- 
ring to  their  experience  in  35  sites.  So  I  sense  that  in  the  35  sites 
that  they  examined — they  were  not  able  to  capture  local  costs 
through  the  records. 

Mr.  Peterson.  Do  you  guys  look  at  that,  or  is  that  something 
you  are  trying  to  do  something  about,  or  is  that  what  SPIR  is 
about? 

Ms.  Greene.  The  standardized  program  information  is  really  just 
a  participant-tracking  system. 

Mr.  Peterson.  How  does  that  work? 

Ms.  Greene.  How  that  will  work  is  that 

Mr.  Peterson.  No.  I  want  to  know  who  is  doing  the  software, 
what  kind  of  machine  is  it  going  to  run  on,  and  where  is  it  coming 
from.  Is  it  something  from  up  here  that  is  being  said  the  agency 
has  to  buy  this  software?  How  does  it  work? 

Ms.  Greene.  At  this  point,  we  do  not  have  standardized  soft- 
ware. What  we  are  asking  is  that  individual  files  would  be  trans- 
mitted to  the  States  and  then  transmitted  to  an  independent  con- 
tractor. The  contractor,  then,  will  set  up  the  national  data  base 
which  will  have— — 

Mr.  Peterson.  You  are  going  to  do  this  by  July  1  and  you  don't 
know? 

Ms.  Greene.  Excuse  me.  We  have  the  program.  In  fact,  we  had 
a  demonstration 

Mr.  Peterson.  What  program? 

Ms.  Greene  [continuing].  Of  the- 


Mr.  Peterson.  Some  contractor  did  the  program? 

Ms.  Greene.  We  have  a  contractor — Meridian  Corp.,  in  Arling- 
ton, VA — that  is  our  ADP  contractor  and  they  are  setting  it  up.  All 
of  the  coding  specifications  were  sent  out  to  the  States  already.  The 
format  was  also  sent  out  to  the  States. 

They  will  be  sending  data  on  disk  or  tape,  in  an  ASCII  file,  so 
that  we  do  not  have  to  impose  a  specific  software  on  States  and  lo- 
calities where  they  may  have  wer\  good  software,  very  good  pack- 
ages already  that  they're  using.  They  [States]  will  be  sending  it  up 
in  a  generic  ASCII  file  and  then,  from  there,  we  would  convert  it 
to  reports. 


211 

Those  reports  will  be  national  reports  that  we  will  use.  We  will 
also  have  State  and  local  reports  as  well.  But  the  data  are  collected 
at  the  local  level  and  then  transmitted  upward  in  a  machine-read- 
able format. 

Mr.  Peterson.  So  the  local  SDA  is  going  to  send  up  an  ASCII 
file  to  the  States 

Ms.  Greene.  To  the  States. 

Mr.  Peterson  [continuing].  And  the  States  are  going  to  accumu- 
late them  for  their  State? 

Ms.  Greene.  That's  correct.  They  would  accumulate  it  for  their 
State.  We  will  have  a  file.  We  will  get  a  tape  from  the  State  that 
will  have  a  record  of  every  individual  in  the  JTPA  program,  in  a 
yearly  submission,  a  batch  file. 

Mr.  Peterson.  So  the  State  is  going  to  take  the  local  SDA's 
ASCII  files  and  combine  them  and  then  send  them  to  you? 

Ms.  Greene.  That's  correct. 

Mr.  Peterson.  Why  do  you  want  to  do  that?  Why  don't  you  just 
take  the  ASCII  file  right  from  the  SDA?  Wouldn't  it  be  easier? 

Ms.  Greene.  Because  it's  a  decentralized  system,  Mr.  Chairman, 
and  certain  responsibilities  are  relegated  to  the  State  as  well  as  the 
locals.  It  also  is  an  opportunity  for  States  to  look  at  the  data  and 
be  able  to  use  the  data  if  they  are  not  already  doing  that. 

Mr.  Peterson.  So  they  are  going  to  take  the  ASCII  files  and  con- 
vert them  into  something  at  the  State  level,  then  they're  going  to 
turn  and  put  it  back  into  an  ASCII  file  and  send  it  to  the  Federal? 

Ms.  Greene.  Most  States  have  their  MIS  system,  for  which  they 
gather  individual  data. 

Mr.  Peterson.  And  that  is  going  to  be  different  from  what  you 
are  doing  now? 

Ms.  Greene.  Every  State,  I  suppose,  has  their  own  system  and 
locals  have  their  own  systems.  Each  has  its  own  MIS  system  and 
its  own  means  of  gathering  information.  What  we  are  doing  is 
we've  just  standardized  the  information,  to  make  sure  that  it  is 
standardized,  which  was  a  point  that  the  IG's  office  made  earlier, 
that  there  was  a  lack  of  standardization. 

We  have  now  standardized  about  55  pieces  of  information.  We 
have  uniformly  defined  them.  We've  sent  the  instructions  out  to  the 
system.  So  now,  the  locals  know  what  needs  to  be  forwarded.  The 
States  have  always  had  the  responsibility  of  maintaining  local  files. 

Mr.  Peterson.  In  other  words,  they  are  going  to  have  to  do 
something  with  their  software  to  accumulate  these  55. 

Ms.  Greene.  That's  correct.  And  we  have  a  technical  assistance 
ADP  contractor  that  is  working  with  the  States  right  now  that  is 
providing  guidance,  technical  assistance,  and  onsite  visits. 

Mr.  Peterson.  They  are  working  with  the  States?  Are  they 
working  with  the  SDA's? 

Ms.  Greene.  The  technical  assistance  contractor  is  federally 
funded.  We've  retained  the  contractor  to  work  with  the  States  and 

the  SDA. 

Mr.  Peterson.  Who  is  the  contractor? 

Ms.  Greene.  Meridian  Corp.  Subcontractors  are  Viar  and  Social 
Policy  Research.  It  is  a  three-pronged  effort  to  provide  automated 
data  processing,  technical  assistance,  reporting,  analysis.  It  is  a 
complete  package. 
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Mr.  Peterson.  And  this  is  going  to  be  done  by  July  1? 

Ms.  Greene.  It's  already — we  had  a  meeting  this  week.  We  had 
representatives  from  15  States  and  about  10  localities,  representing 
every  region  of  the  country.  We  did  a  status  report.  We  did  an  as- 
sessment and  needs  survey  about  6  months  ago,  and  we  are  pretty 
confident,  with  the  exception  of  four  States,  that  they  will  be  up 
and  running;  and  in  those  four  States  we  are  sending  the  contrac- 
tor out  onsite  to  guarantee  that  this  will  be  up  and  running  by  July 
1. 

Mr.  Peterson.  What  is  this  going  to  cost? 

Ms.  Greene.  For  developmental  costs  and  all  the  technical  as- 
sistance that's  involved  in  the  site  visits,  it  is  slightly  over  $1  mil- 
lion for  the  first  20  months.  The  cost  should  be  reduced  substan- 
tially after  the  initial  20  months,  once  the  system  is  up  and  run- 
ning. 

Mr.  Peterson.  That's  for  software  development,  mostly 

Ms.  Greene.  That's  right. 

Mr.  Peterson  [continuing].  Training? 

Ms.  Greene.  They  will  be  developing  peripheral  software,  which 
will  be  made  available  to  States  and  localities.  However,  we  did  not 
want  to  standardize  that  if  States  felt  that  they  could  more  easily 
extract  from  their  existing  systems  the  information  we  wanted. 

Mr.  Peterson.  So  is  the  software — I  mean,  some  people  are  run- 
ning on  AS-400's  and  some  are  running,  I  suppose,  on  PCs,  and 
some  are  running  on  mainstreams? 

Ms.  Greene.  We've  done  an  assessment  to  find  out  the  hard- 
ware. 

Mr.  Peterson.  So  they're  going  to  provide  the  software  and  all 
these  different  formats?  Is  that  the  deal? 

Ms.  Greene.  That's  true.  But  we  have  conversion  packages.  The 
other  thing  that  I  need  to  explain  to  you  is  that  we  do  have  a  fund- 
ing source — it's  called  a  6  percent  setaside — at  States'  disposal  for 
technical  assistance. 

In  anticipation  of,  perhaps,  some  of  the  MIS  changes  that  would 
be  needed  to  implement  this  standardized  system,  we  gave  them, 
during  this  transition  period,  the  opportunity  to  use  some  of  that 
money  to  make  their  systems  compatible  if  they  needed  to.  That  is 
being  done  right  now,  and  that  is  probably  the  reason  why  most 
of  the  States  now  feel  that  they  will  be  in  a  position  where  they 
can  comply  with  this  new  system. 

Mr.  Pi:TERSON.  Is  everybody  going  to  be  in  agreement  on  the 
kinds  of  things  that  you  are  accumulating?  When  I  sit  around  and 
listen  to  all  these  different  people,  I  hear  them  arguing  amongst 
themselves  about  whether  you're  accumulating  the  right  thing  or 
not,  or  whether  you  can't  really  rely  on  this  because  you  made 
some  judgment  that  this  is  how  it  should  work. 

Has  that  been  resolved,  or  are  we  going  to  have  people  arguing 
when  we  get  all  this  accumulated,  arguing  that  we  accumulated 
the  wrong  thing  and  it  does  not  mean  anything? 

Ms.  Greene.  We  have  had  an  elaborate  process  of  developing 
this  particular  record,  and  we  started  it  back  in  October  1991.  we 
have  had  a  series  of  technical  work  groups,  "Federal  Register"  no- 
tices, and  solicited  comments  on  the  information  we  are  collecting. 
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We  are  certainly  within,  I  think,  the  JTPA  community,  in  agree- 
ment that  what  we  are  collecting  probably  the  most  complete  infor- 
mation and  will  address  all  of  the  issues. 

Mr.  Peterson.  Will  the  IG  agree  with  that? 

Ms.  Greene.  Let  me  just  explain.  The  one  issue  that  I  must  say 
we  have  not  been  able  to  address  in  this  is  the  accumulation  of 
AFDC  data  pre-  and  post-program. 

That  particular  area  is  an  area — probably  the  only  area,  to  my 
knowledge,  that  I  know — where  there  would  be  any  disagreement 
between  the  IG  and  the  Department  of  Labor,  because  the  IG 
worked  very  closely  with  us  in  the  development  of  this  instrument. 
They  were  a  part  of  every  technical  work  group.  They  responded 
to  our  public  comment  process.  And  we  met  with  the  IG  before  it 
was  developed. 

So  we  have  worked  with  the  IG.  The  one  area  where  we  were  un- 
able to  comply,  I  think,  with  what  they  would  like,  is  to  require 
that  every  record  have  AFDC  grant  amounts,  and  that  we  look  at 
pre-  and  post-grant  allotments.  The  reason  why  we  did  not  do  that 
is  because  it  is  an  extremely  costly  process  right  now  to  accumulate 
that  kind  of  information. 

We  are  dealing  with  over  1  million  JTPA  participants.  That 
would  mean  attachment  of  AFDC  records  of  nearly  40  or  50  per- 
cent of  those  participants.  In  manv  States — we  polled  the  States — 
they  said  that  they  did  not  have  the  formalized  arrangements  that 
would  be  necessary  in  order  to  access  individual  AFDC  files.  They 
do  it  at  the  local  level  in  some  areas,  but  it  is  not  a  typical  situa- 
tion. It  would  be  costly. 

Also,  our  reporting  system  is  subject  to  the  Office  of  Management 
and  Budget  review  process.  We  are  under  a  paperwork  reduction 
authority.  Every  one  of  our  data  collection  surveys  must  be  re- 
viewed by  the  Office  of  Management  and  Budget. 

We  have  had  difficulty  in  the  past  getting  approval  from  that 
particular  office  in  the  quantity  of  data,  because  of  the  reporting 
burden  that  it  would  place  on  the  system.  That  is  the  reason  why 
we  go  through  an  elaborate  public  comment  process. 

I  think  that  if  we  were  to  ask  the  system — and  we  did,  in  a  work 
group,  pose  the  question  before  20  State  people  and  about  20 
locals — ^"Would  you  be  able  to  accumulate  the  desirable  AFDC 
records  so  we  could  get  grant  amounts?"  We  were  told  that  it  would 
be  extremely  burdensome,  very  costly,  and  they  would  oppose  it  in 
the  public  comment  process. 

Mr.  Williams.  Is  that  for  reasons  of  confidentiality? 

Ms.  Greene.  Confidentiality  was  an  overriding  issue,  because  it 
would  have  client  information.  It  could  have  also  case  numbers  and 
Social  Security  numbers  on  it,  which  were  confidential. 

Mr.  Peterson.  Could  you  provide  to  the  committee,  for  the 
record,  the  specifics  of  this  program?  The  55,  whatever  it  is? 

Mr.  Williams.  Yes,  sir. 

Ms.  Greene.  Sure. 

Mr.  Peterson.  And  the  contract,  and  just  what  you're  up  to  with 
this  whole  thing,  so  we  can  understand  it  better? 

Mr.  Williams.  Yes,  sir. 

Mr.  Peterson.  The  second  panel  that  we  had  today  was  con- 
cerned that  what  we  did  with  the  1992  amendments  was  going  to 
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take  away  flexibility  at  the  local  level,  and  it  may  be  counter- 
productive to  dealing  with  the  local  needs.  How  do  you  respond  to 
that? 

Mr.  Davies.  The  JTPA  system,  when  enacted  in  1982,  provided 
broad  flexibility  on  the  kinds  of  interventions  that  could  be  pro- 
vided for  any  individual.  After  a  period  of  operation,  the  view 
was — and  everything  that  we  heard  from  our  experts  in  the  first 
panel  this  morning  was — that  limited  interventions  had  limited  im- 
pact. 

The  view  of  the  community  and  the  authorizing  committees  and 
the  Department  was,  we  had  to  restructure  JTPA  in  a  manner  that 
it  ensured  a  more  intensive,  more  targeted  individual  intervention. 
That  is  essentially  what  we  have  done. 

Certainly,  some  people  would  be  of  the  view  that  that  was  unnec- 
essary, that  the  local  community,  the  local  planners,  have  a  better 
view  of  that  and  should  be  given  full  flexibility  in  whatever  serv- 
ices, whether  it  be  just  job  search  alone,  as  the  activity  in  JTPA. 
Our  view  was  that  we  had  to  provide  greater  specificity  in  terms 
of  the  intervention,  and  that  is  essentially  what  we  provided. 

By  and  large,  though,  the  system  buys  into  that  notion  now  and, 
certainly,  while  there  is  some  exception  to  that  even  among  the 
witnesses  today,  I  think,  by  and  large,  the  system  agrees  that  an 
ensured  comprehensive  intervention  for  all  participants  in  the  pro- 
gram  is  the  most  appropriate  strategy. 

Mr.  Peterson.  There  have  been  some  people  that  have  criticized 
the  ABT  study  because  they  didn't  think  it  included  everybody  it 
should  have,  or  whatever.  Is  this  new  SPIR  deal,  is  that  going  to 
eliminate  the  need  for  doing  these  kinds  of  studies? 

I  mean,  are  we  going  to  have  all  this  information,  now,  and  is 
it  going  to  be  absolutely  accurate  and  everybody  is  going  to  ag^ee 
on  it? 

Ms.  Greene.  Nothing  satisfies  everybody.  I  would  say  that  the 
SPIR  will  bring  our  agency  and  our  program  probably  to  a  point 
where  we  have  more  information  on  what  services  seem  to  work  for 
certain  subgroups  in  the  population,  and  outcomes — what  we  call 
outcomes,  or  successes,  if  you  want  to  call  it  that — are  a  better 
measure  of  our  ability  to  place  people  and  wages  for  people  who  are 
in  different  target  groups. 

In  terms  of  oeing  able  to,  I  think,  eliminate  the  need  for  re- 
search, no  management  information  system  can  eliminate  the  need 
for  research.  You  need  to  go  onsite.  You  need  to  look  at  the  context 
in  which  these  people  are  oeing  served  and  the  local  labor  market. 

You  need  to  talk  to  the  people  who  are  staffing  progp'ams.  You 
need  to  know  more  about  the  dynamics  of  the  programs.  So  there 
will  always  be  a  need  for  continuing  research. 

The  management  information  system  gives  you  a  glimpse,  but 
you  really  have  to,  in  order  to  see  which  are  the  most  effective  pro- 
grams, you  have  to  have  what  we  would  call  more  process  and, 
also,  more  of  the  experimental  kinds  of  research  that  were  de- 
scribed this  morning. 

An  MIS  system  cannot  answer  the  question,  "What  would  hap- 
pen in  the  absence  of  the  program?" 

Mr.  Peterson.  Right.  Do  you  do  that?  I  mean,  do  you  have  peo- 
ple in  the  Department  that  go  out  and  do  this? 
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Ms.  Greene.  No,  we  fund  almost  all  of  our  research  to  outside 
contractors  who  do  the  field  work. 

Mr.  Peterson.  Why  do  you  do  that? 

Ms.  Greene.  We  do  it  competitively. 

Mr.  Peterson.  Why  do  you  do  that? 

Ms.  Greene.  Why  would  we  fund  contractors? 

Mr.  Peterson.  Why  don't  you  do  it  yourselves? 

Ms.  Greene.  Because  of  staffing  limitations.  We  have  five  indi- 
viduals who  are  responsible  for  our  research  and  evaluation.  They 
constitute  our  research  and  evaluation  staff  for  the  agency. 

Mr.  Peterson.  Five  people? 

Ms.  Greene.  Five  people 

Mr.  Peterson.  Have  you  asked  for  more  people? 

Ms.  Greene  [continuing].  In  our  research  and  our  evaluation. 

Mr.  Peterson.  Have  you  asked  for  additional  positions? 

Ms.  Greene.  In  the  past,  I  think  we  have. 

Mr.  Da  VIES.  Individual  offices  always  ask  for  more  staff. 

Mr.  Peterson.  I'm  not  talking  about  staff.  I'm  talking  about  this 
specific  function.  Have  you  asked? 

Ms.  Greene.  For  research  and  evaluation,  I  think  we  always  go 
in  with  a  request  for  more. 

Mr.  Peterson.  How  manv  more?  For  10  instead  of  5,  or  what? 

Ms.  Greene.  Given  the  met  that  we  have,  at  times,  had  dem- 
onstrations that  we  have  been  responsible  for,  we  have  gone  in 
probably  with  requests  for  considerably  more  than  what  we  have 
right  now.  But  the  reality  of  the  situation  is  that  we  are  in  a  mode 
of  cutting  back;  we're  not  in  a  mode  of  expanding.  Research  and 
evaluation  is  usually  the  first  thing  to  go  when  you  are  in  a  mode 
of  cutting  back  on  Federal  resources. 

Mr.  Peterson.  I  guess  in  the  1992  amendments,  they  changed 
these  percentages  where  they  used  to  be  70,  15,  and  15? 

Mr.  Williams.  Cost  limitations,  yes,  sir. 

Mr,  Peterson.  And  now  the  administrative  are  20  percent? 

Mr.  Da  vies.  Yes,  sir. 

Mr.  Peterson.  Do  you  think  that  is  kind  of  arbitrary,  or  do  you 
think  that  is  some  kind  of  magic  number? 

Mr.  Davies.  We  spent  considerable  time  looking  at  the  actual 
costs  in  the  system.  There  is  tremendous  variability  in  terms  of  the 
size  of  service  delivery  areas  in  the  system  and,  obviously,  the 
amoimt  of  the  administrative  costs  is  going  to  vary  in  terms  of 
economy  of  scale.  It  is  easier  for  New  York  City  to  operate  on  20 
percent  than  it  may  be  for  a  much  smaller  service  delivery  area. 

We  felt  though  tnat,  on  balance,  the  20  percent  administrative 
cost  limitation  was  fair  and  that  the  program  could  be  properly  ad- 
ministered within  that  limit. 

Mr.  Peterson.  It  was  15  before? 

Mr.  Williams.  Yes,  sir.  It  was  15  before. 

Mr.  Peterson.  And  that  was  not  adequate? 

Mr.  Davies.  Part  of  the  problem  that  we  dealt  with  in  the 
amendments  was  to  get  a  better  handle  on  where  the  expenditures 
were  going  in  JTPA.  The  method  of  accounting  for  costs  in  the  sys- 
tem was  such  that  it  was  hard  to  get  a  handle  on  how  much  ad- 
ministrative costs  there  really  was  in  the  system. 

Mr.  Peterson.  Do  you  have  a  handle  now? 
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Mr.  Da  VIES.  Yes.  The  amendments  provide  for  a  much  more  ex- 
plicit set  of  requirements  for  how  costs  are  accounted  for  in  the 
JTPA  system. 

Mr.  Peterson.  But  they  have  not  been  implemented  yet. 

Mr.  Davies.  They  will  be  implemented  on  July  1. 

Mr,  Peterson.  So  you  think  that  you  will  have  this  information, 
but  we  don't  know  at  this  point? 

Mr.  Davies,  I  know  that  in  working  with  the  inspector  general's 
office  and  the  other  people  that  have  a  concern  about  this,  that 
we've  set  up  systems  that  should  ensure  that  costs  are  properly  ac- 
counted for. 

Mr.  Peterson.  How  would  you  track  this?  Through  the  audit  re- 
ports that  come  in?  Is  that  how  you  track  this? 

Mr.  Davies.  The  costs  will  be  tracked  both  within  the  reporting 
system  and  in  the  audit  reports. 

Mr.  Peterson.  So  when  these  audits  come  in  from  these  600- 
and-some  agencies,  you  have  somebody  in  your  shop  that  accumu- 
lates all  this?  Is  that  how  it  works? 

Mr.  Davies.  The  audit  process — and  it  is  unfortunate  that  our 
OIG  colleagues  are  not  following  us  rather  than  us  following 
them — the  audit  activity  is  the — in  fact,  I'll  ask  Bryan,  who  han- 
dles that 

Mr,  Peterson,  Well,  when  I  use  to  do  audits,  I  used  to  send  all 
these  copies  to  the  Department  of  Labor  in  Chicago,  I  think.  I  used 
to  have  to  send  10  audits,  I  never  could  figure  out  what  we  were 
up  to.  It  said  in  this  book  we  were  supposed  to  send  them  there, 
so  we  did.  I  often  wondered  whatever  happened  with  them. 

Mr.  Williams,  The  process  works  this  way.  The  IG  contracts  or 
performs  the  audits.  The  audits  then  come  to  the  program  agency. 

Mr.  Peterson.  Then  the  IG  doesn't  perform  the  audits;  the  local 
auditors  perform  the  audits. 

Mr.  Williams.  There  are  two  different  kinds. 

Mr.  Peterson.  Isn't  that  where  you  get  the  information? 

Mr.  Williams.  Generally,  audits  performed  at  the  local  level, 
then,  are  rolled  up  to  the  State  level.  They  are  reviewed  at  the 
State  level  for  questioned  costs  and  for  disallowed  costs,  and  then 
they  are,  in  turn,  reviewed  by  the  national  staff  here  to  see  if  there 
is  agreement  with  the  action  taken. 

Mr.  Peterson,  When  you  say  reviewed,  you  basically  look  at  the 
last  page  and  see  if  there  are  any  questioned  costs? 

Mr,  Williams,  No, 

Mr,  Peterson,  Do  you  actually  look  at  the  whole  report? 

[Mr,  Williams  nods.] 

Mr.  Peterson,  How  many  people  do  you  have  doing  that? 

Mr,  Keilty,  We  have  in  our  audit  resolution  and  closeout  and 
debt  management  staff,  I  would  imagine,  about  30  people. 

Mr.  Peterson,  And  they  are  able  to  do  that?  And  then  you  put 
all  of  this  into  some  data  base  or  something,  or  how  does  that 
work? 

Mr,  Keilty,  We  have  a  data  base  that  tracks  these  audits  when 
they  come  in,  where  they  are,  what  state  of  the  process  we  are  in, 
resolution. 
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Mr.  Peterson,  So  you  are  basically,  though,  relying  on  these 
local  auditors  to  determine  whether  they  are  within  the  20  percent 
requirements,  or  15,  right? 

Mr.  Keilty.  That's  correct. 

Mr.  Peterson.  And  you  don't  really  have  any  way  of  going  in 
and  doing  any  testing  on  whether  they  actually  are  in  compliance 
or  not;  you  just  take  tneir  word  for  it? 

Mr.  Keilty.  We  have  had — ^you  know,  you  get  into  the  question 
of  our  oversight  monitoring  of  the  program.  We  have  been  doing  a 
lot  of  oversight  and  monitoring  of  the  system  over  the  last  couple 
of  years  in  the  areas  of  procurement  and  on-the-job  training. 

In  fact,  our  own  staff  visited  and  monitored,  over  the  course  of 
the  3  years  of  this  extensive  process,  every  single  SDA  in  the  Na- 
tion. 

Mr.  Williams.  We  took  staff  from  the  State.  We  went  in  and  we 
looked  at  procurement,  we  looked  at  their  recordkeeping  and  re- 
porting, we  looked  at  on-the-job  training,  and  required  specific  cor- 
rective actions  in  every  case  where  we  found  a  problem,  and  dis- 
allowed costs  or  referred  special  areas  where  we  found  problems, 
referred  that  to  audit. 

Mr.  Peterson.  Do  you  have  a  handle  on  the  people  that  are 
doing  these  audits?  I  mean,  my  limited  experience  is  that  I  think 
there  are  probably  a  lot  of  people  out  there  doing  these  audits  that 
wouldn't  know  if  these  costs  were  appropriate  or  not. 

I  don't  think  they  have  the  training  to  know — even  if  they  could 
use  the  auditing  techniques  to  find  out  the  information,  I'm  not 
sure  they  would  know  whether  these  are  administrative  costs  or 
not.  Would  you  disagree  with  that,  that  there's  a  fair  number  of 
them  that 

Mr.  Keilty.  I  don't  know  "fair"  number.  It's  a  good  thing  the  in- 
spector general  isn't  here.  I've  had  concern  about  the  quality  of  the 
contract  auditors  the  inspector  general  uses  on  doing  some  of  his 
own  audits.  So  yes,  that  and  the  issue  of  whether  the  Single  Audit 
Act 

Mr.  Peterson.  Do  you  think  that  has  been  helpful?  Do  you  think 
that  the  Single  Audit  Act 

Mr.  Keilty.  Well,  it's  good 

Mr.  Peterson  [continuing].  Has  accomplished  anything? 

Mr.  Keilty.  No.  I  mean 

Mr.  Williams.  No.  One  of  the  things  that  we've  constantly  raised 
questions  about  is  the  need  for  more  financial  audits;  and,  indeed, 
we've  worked  with  the  inspector  general  where  we've  seen  specific 
areas  we  felt  needed  to  be  audited,  and  asked  for  specific  audits, 
because  that's  one  of  the  problems  with  the  Single  Audit  Act.  It 
only  picks  up,  in  some  cases,  a  very  few  transactions  within  our 
area. 

So  we've  had  to  ask  for  more  specific  financial  audits  in  those 
areas  where  we  are  monitoring  and  showing  that  we  have  reason 
to  be  concerned  about  the  audit  process  there. 

Mr.  Peterson.  There  is,  I  think,  a  requirement  that  they  are 
supposed  to  look  at  whether  there  is  compliance  with  the  regula- 
tions, right?  Do  you  think  that  is  really  happening,  to  any  extent? 
Do  you  think  that  they  actually  know  enough  to  know  what 
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Mr.  Williams.  Well,  there  are  certainly  a  number  of  cases  where, 
between  the  monitoring  and  the  audit,  there  are  cases  that  come 
up  to  us  for  resolution  or  for  further  investigation  or  further  audit- 
ing and  there  are  not  only  corrective  actions  tfiken  administratively 
but  there  are  dollars  repaid  to  the  Treasury  based  upon  those  dis- 
allowances. 

So  certainly  there  is  activity  that  is  ongoing.  But  I  think  it  is  fair 
to  say,  and  I  think  the  IG  would  a^ee  with  this,  that  it  is  of  un- 
even quality,  and  I  would  agree  with  your  comment  on  that.  We 
find  some,  both  in  terms  of  the  people  who  do  it  under  contract  for 
the  IG  and  also  the  people  who  are  doing  it  at  the  local  level. 

There  is  an  unevenness.  Despite  development  of  audit  guides,  de- 
spite training,  despite  increased  retraining,  there  is  still  some  un- 
evenness out  there. 

Mr.  Davees.  But  the  rules  and  the  amendments  now  provide  for 
a  much  more  explicit  delineation  of  what  the  cost  categories  are 
and  what  is  to  be  charged.  We've  provided  extensive  training  to  the 
States  already  on  financial  management.  There  is  a  technical  as- 
sistance guide  that  is  going  to  be  developed  and  issued.  So  we  are 
working  at  making  sure  that  costs  are  properly  charged  and  ac- 
counted for  in  the  system. 

Mr.  Peterson.  Do  you  work  with  the  State,  and  the  American 
Institute  and  State  societies  of  CPA's?  You  are  working  with  the 
State  agency? 

Mr.  Williams.  I  think  there  are  a  couple  of  things  that  are  ongo- 
ing. Certainly,  the  IG,  in  their  own  activity,  the  inspector  general's 
office  works  with  all  of  those  organizations. 

We  also  meet  frequently  with — ^in  fact,  Mr.  Davies  just  recently 
came  back  from  a  meeting  where  he  was  talking  about  the  amend- 
ments— meet  frequently  with  people  who  are  tne  JTPA  auditors, 
associations  that  work  only  on  our  activity  or  primarily  on  our  ac- 
tivity. 

Mr.  Peterson.  You  are  involved  in  helping  to  train  those  people? 

Mr.  Williams.  We  are  involved  with  exchanging  ideas  with  those 
people,  gfiving  them  information,  training,  answering  their  ques- 
tions. New  amendments,  in  fact,  that  was  the  key  to  Mr.  Davies' 
presentation  out  there,  to  talk  about  the  amendments,  their  im- 
pact, the  tightening  of  the  definitions  and  the  charging  to  the  cost 
categories,  and  to  be  available  to  answer  questions. 

We  frequently  meet  with  that  association,  but  also  with  individ- 
ual JTPA  auditors  who  have  difficulties  or  need  questions  an- 
swered. 

Mr.  Peterson.  The  inspector  general  called  for  more  oversight. 
Do  you  have  the  resources  to  comply  with  that,  realistically? 

Mr.  Williams.  The  inspector  general's  office  talked  with  us  in 
August  of  last  year  and  looked  at  the  issue  specifically  of  oversight, 
and  looked  at  a  situation  in  terms  of  our  own  plans,  and  indicated 
that,  over  a  2-year  period,  it  would  be  helpful  if  we  had  some  addi- 
tional staff*  that  could  be  trained  and  moved  into  oversight  activity. 

Bryan. 

Mr.  Keilty.  Mr.  Chairman,  in  point  of  fact,  in  our  1994  budget 
request  to  the  Congress,  the  Assistant  Secretary  sent  forward  a 
budget  calling  for  additional  staff  resources  for  ETA  to  be  used, 
partially  because  of  the  JTPA  amendments  and  also  because  of  the 
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economic  investment  package  that  the  President  had  included  but 
clearly,  within  the  budget  itself,  a  recognition  that  because  of  the 
JTPA  amendments,  more  resources  were  required  in  ETA,  not  only 
people  but  travel  and  all  sorts  of  resources  that  we  would  need  to 
do  that  job. 

Mr.  Williams.  Clearly,  what  we  did  3  years  ago,  was  we  utilized 
staff  in  all  of  our  regional  offices  as  well  as  the  national  office,  and 
even  diverted  some  staff  from  other  activities  to  do  the  very  in- 
depth  review  that  we  did  on  procurement  and  on-the-job  training, 
recordkeeping,  at  every  one  of  the  service  delivery  levels. 

That  is  very  difficult  on  not  only  the  staff,  but  on  the  system,  be- 
cause they  are  forced  to  move  from  other  activities  but  it  in  fact 
did  get  a  number  of  corrective  actions  in  the  system,  and  I  think 
it  helped  train  the  States  further  in  terms  of  how  to  go  about  some 
of  the  monitoring  activities  in  a  more  aggressive  fashion. 

I  heard  some  discussion  earlier  today  about  passivity,  and  I  can 
assure  you  that  many  of  the  people  at  the  local  level  thought  that 
there  was  anything  but  passivity  when  we  were  going  out  and  try- 
ing to  work  to  correct  some  of  these  problems. 

Particularly  in  the  procurement  area  we  found  that  to  be  nec- 
essary, and  we  worked  in  two  ways.  We  worked  with  the  States 
and  the  service  delivery  areas  on  the  reviews  but  then  we  also 
went  back  and  worked  with  them  on  the  corrective  actions  and  on 
the  technical  assistance,  so  the  problems,  hopefully,  would  not 
occur  again. 

Mr.  Davies.  You  asked  a  question  earlier  in  the  hearing  about 
the  role  of  the  States.  There  are  two  principal  things  that  we  de- 
pend on  States  doing.  One  is  to  administer  the  program.  An  essen- 
tial part  of  that  is  to  carry  out  oversight. 

We  have  done  a  number  of  things  to  be  much  more  directive  with 
the  States  about  what  their  responsibility  is  for  administration 
and,  in  particular,  the  oversight. 

Mr.  Williams.  The  Governor  is  specifically  charged  with  certain 
annual  reviews  and  certifications  as  to  written  procurement  sys- 
tems and  other  recordkeeping  processes  to  be  in  place. 

Mr.  Peterson.  How  is  that  done?  Through  the  State  auditors,  or 
what? 

Mr.  Williams.  Well,  through  the  Glovernors'  own  oversight  staffs. 

Mr.  Peterson.  Somebody  on  the  Governor's  staff? 

Mr.  Williams.  No,  the  people  who  are  working  in  the  JTPA  pro- 
CTam.  We  indicated  earlier  there  were  about  2,500  of  those  people. 
But  they  do,  in  fact,  borrow  from  the  State  auditor's  staff  and  from 
other  people  that  they  need  in  the  State  as  well  as  ask  our  own 
people  to  go. 

Many  of  these  reviews  are  done  jointly,  because  there  may  be 
certain  levels  of  expertise  in  certain  areas — for  example,  in  report- 
ing or  accounting — where  specific  staff  are  detailed  for  the  purpose 
of  these  reviews. 

Ms.  Greene.  And  to  add  to  that,  you  asked  why  we  were  not 
asking  for  this  information  directly  from  the  localities  rather  than 
going  to  the  States.  The  primary  role  of  the  States  is  to  assess  an- 
nually the  performance  of  the  local  programs  within  the  State  and 
to  reward,  based  on  this  performance  data,  those  programs  that  are 
exceeding  their  standards. 
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They  actually  have  a  set-aside  that  is  targeted  for  rewards  for 
good  performance.  So  it  is  the  State  responsibility  to  impose  the 
performance  standards,  to  assess  program  performance  at  the  end 
of  the  year  against  those  standards,  and  to  reward  those  programs 
that  are  doing  well  and  to  provide  technical  assistance  to  those 
that  did  not  meet  their  standards.  So  the  States  play  an  integral 
part. 

We  would  not  want  to  circumvent  that  particular  line  or  area  of 
authority  to  ask  for  information  that  we  would  need,  to  look  at 
local  performance  and  to  use  our  own  evaluation  purposes,  because 
we  used  that  data  base  to  set  the  national  standards  and  to  de- 
velop new  standards.  We  would  want  to  have  the  States  incor- 
porated in  that  process. 

Mr.  Williams.  I  think  States  also  help  in  the  overall  planning 
of  their  human  resources  services  and  the  new  human  resources  in- 
vestment counselor  with  broadly  based  representation  is  also  going 
to  help,  I  think,  in  that  planning  and  coordination  of  statewide 
human  resources  services,  not  just  in  the  job  training  area,  but 
generallv  in  the  State. 

I  think,  as  was  mentioned  earlier  today,  there  is  also  a  role  in 
terms  of  dislocated  workers  where  there  is  a  need  for  the  State.  It 
has  some  responsibility  in  terms  of  rapid  response,  and  some  con- 
tinued responsibility  in  working  with  unemployed  workers  at  the 
statewide  level  and  trying  to  train  and  find  new  jobs  in  emerging 
areas. 

Mr.  Peterson.  We  are  running  overtime  here.  There  is  one  more 
thing,  and  we  will  probably  have  some  other  questions  that  we  will 
send  to  you. 

Mr.  Williams.  Yes,  sir. 

Mr.  Peterson.  In  terms  of  trying  to  take  what  works  and  expand 
it,  and  take  what  does  not  work  and  eliminate  it,  suppose  you  are 
working  with  the  States — how  does  that  all  work?  Are  you  basically 
leaving  that  up  to  the  States  as  well,  or  do  you  have  some  strategy 
at  the  Federal  level  where  you  identify  what  is  working? 

Mr.  Davdes.  There  has  been  an  ongoing  activity  wherein  we 
share  results  with  the  JTPA  system  through  the  Governors  and 
through  the  various  associations  that  respond  to  the  system.  But 
the  1992  amendments  provide  for  a  much  expanded  capacity  build- 
ing activity  in  the  JTPA  system  where  training  for  staff  and  shar- 
ing of  successful  models  will  be  carried  out.  States  receive  a  portion 
of  monev  to  go  toward  that  and  the  Department  has  a  responsibil- 
ity for  snaring  those  positive  standards  and  positive  programs. 

The  most  immediate  thing  that  we  are  doing  is,  as  a  followup  to 
the  training  on  the  basic  regulations,  going  out  and  providing  sub- 
ject-specific training  on  successful  assessment  techniques;  youth 
models  that  seem  to  work,  even  though  we're  struggling  with  that; 
case  management;  financial  management;  all  of^the  individual 
things  that  we  think  need  to  be  understood  to  operate  successful 
programs,  including  good  model  progprams. 

Mr.  Williams.  Thank  you. 

Mr.  Peterson.  Thank  you  all  very  much  for  your  testimony.  We 
may  be  looking  at  this  some  more.  But  if  you  would  be  kind  enough 
to  answer,  we  may  have  a  few  questions  we  might  submit  to  you. 
Keep  us  apprised  of  what  you  are  up  to  over  there. 
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Mr.  Williams.  Yes,  sir. 

Mr.  Peterson.  We  appreciate  you  being  with  us. 

Mr.  Williams.  Thank  you,  Mr.  Chairman.  Thank  you  for  having 
us. 

Mr.  Peterson.  This  subcommittee  is  adjourned. 

[Whereupon,  at  12:45  p.m.,  the  subcommittee  adjourned,  to  re- 
convene subject  to  the  call  of  the  Chair.] 
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I  am  here  today  to  discuss  Issues  initiated  by  the  Departmeat  of  La- 
bor's inspector  general  regarding  the  Job  Training  Partnership  Act.  Those 
seven  issues  are:  (1)  Whether  the  Job  placeaent  performance  measure  used 
encourages  SDAs  to  work  with  the  participants  who  need  the  least  help  and 
place  them  in  low-paying  jobs  which  they  could  have  obtained  without  assis- 
tance; (2)  what  the  long-term  benefits  are  to  the  participants:  (3)  wheth- 
er JTPA  is  concentrating  on  job  placement,  which  should  be  the  role  of  the 
state  employment  services,  instead  of  training;  (4)  whether  JTPA  fimds  are 
being  used  to  subsidize  local  businesses  who  would  have  hired  some  of  the 
same  employees  without  the  program;  (5)  whether  JTPA  programs  are  complying 
with  their  remedial  education  mandate;  (6)  whether  youth  in  Summer  Youth 
Programs  are  properly  supervised  for  work  output;  (7)  whether  the  70  per- 
cent of  the  monies  statutorily  designated  for  job  training  are  instead 
being  applied  to  administrative  costs;  and  whether  the  cost  effectiveness 
of  the  programs  can  be  measured. 

First,  1  would  like  to  give  you  a  brief  background  of  Rural  Minnesota 
CEP  (Concentrated  Employment  Programs). 

Rural  Minnesota  CEP,  Inc.,  a  private  non-profit  organization  incorpo- 
rated in  1968,  operates  employment  and  training  programs  under  the  Job 
Training  Partnership  Act  (JTPA) .  The  basic  purpose  of  the  organization  is 
to  provide  job  training  and  employment  opportunities  to  economically  disad- 
vantaged, unemployed  and  underemployed  people.  The  goals  are  to  increase 
the  client's  earned  income,  maximize  employment  opportunities,  and  enhance 
self-sufficiency.  Rural  Minnesota  CEP  is  unique  aatong  JTPA  Service  Deliv- 
ery Areas  by  virtue  of  its  private  non-profit  status.  In  1973,  when  CETA 
was  passed,  only  four  Rural  Concentrated  Employment  Programs  (CSPs)  were 
designated  CETA  prime  sponsors.  Past  accomplishments  and  admlnistrativ* 
capabilities  were  considered  in  the  prime  sponsor  designation.  The  same 
considerations  were  used  when  Rural  Minnesota  CEP  was  designated  «  JTPA 
service  deliverer  in  1982  (SDA2).  RMCEP  is  also  a  service  provider  for  the 
JOBS  Program  and  the  federal  dislocated  worker  program  (EDVAA). 
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Rural  Minnesota  CEP  is  one  of  seventeen  Service  Delivery  Areas  receiv- 
ing funds  under  the  Job  Training  Partnership  Act  in  Minnesota.  Rural  Minne- 
sota CEP  not  only  administers  these  funds  but  also  provides  the  services. 
Services  include:  Career  Planning,  On-the-Job  Training,  Vork  Training, 
Life  Skills,  and  Job  Search.  Adult  Basic  Education.  General  Education 
Diploma  Training,  English  as  a  Second  Language,  High  School  Diploma  and 
Post-Secondary  Vocational  Classroom  Training  are  provided  to  Rural  Minneso- 
ta CEP  clients  through  local  education  agencies. 

Rural  Minnesota  CEP  works  closely  with  State  and  County  elected  offi- 
cials as  well  as  representatives  of  the  three  Indian  reservations  found 
within  the  area.  Every  program  operated  by  the  Agency  is  reviewed  by  the 
Private  Industry  Council  which  is  comprised  of  local  business  people,  educa- 
tors, economic  developers  and  representatives  of  other  agencies.  A  Board 
of  Directors,  whose  members  represent  a  wide  cross-section  of  rural  life, 
provides  direction  and  guidance  to  the  organization. 

In  its  24  year  history.  Rural  Minnesota  CEP  has  managed  over  $228  Bil- 
lion in  private,  county,  state  and  federal  funds,  and  provided  employment 
and  training  services  to  approximately  133,600  uneiq>loyed,  economically 
disadvantaged  persons.  In  Program  Year  1991,  over  80Z  of  the  adult  partici- 
pants who  left  our  Job  Training  Partnership  Act  Title  IIA  program  found 
unsubsidized  employment.  Other  participants  returned  to  school,  joined  the 
military,  or  decided  to  continue  in  other  training  as  a  result  of  their 
experience  with  Rural  Minnesota  CEP.  Over  85Z  of  the  participants  In  the 
Tooth  Program  entered  employment  or  achieved  a  Youth  Eq>loyablllty  Enhance- 
ment outcome.  The  agency  %rorked  with  over  9,300  participants  in  all  of  Its 
programs  in  the  Program  Year  ending  J\ine  30,  1992. 

The  area  served  by  Rural  Minnesota  CEP  Is  Service  Delivery  Area  2. 
(Attachment  A).  The  population  density  averages  only  20  people  per  square 
■lie.  Only  four  of  the  cities  have  a  population  over  10,000.  The  rural 
nature  of  the  area  creates  a  challenge  for  any  job  seeker.  Low  wages  and 
uneaq>loyment  are  typical  In  the  SDA  2  are«.  The  median  hourly  wage  Is  83X 
of  the  state  median  hourly  wage.  Tlie  1989  per  capita  Incoow  ranged  froa 
below  $11,000  In  Clearwater  County  to  above  $17,000  In  Traverse  County}  th« 
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State  per  capita  income  was  $18,731.  The  SDA  2  unemployment  rate  was  6.7Z 
in  1992  compared  to  a  state  unemployment  rate  of  S.OZ. 

Issue  1:   PERFORMANCE  STAHDAIDS 

Performance  standards  are  a  measure  of  the  quality  and  accountability 
of  the  delivery  of  employment  and  training  services.  In  the  program  year 
ending  June  30,  1992  both  the  State  of  Minnesota  and  Rural  Minnesota  CEP 
achieved  high  performance.  These  outcomes  were  achieved  because  RMCEP  and 
other  Minnesota  SDAs  offer  quality  services  to  all  Individuals.  The  out- 
come of  $260 /week  at  follow-up  for  %felfare  recipients  is  considerably  above 
the  $170/week  an  individual  working  for  the  minimoa  wage  vrould  earn. 

JTPA  II-A 

PROGRAM  YEAR  1991 

Performance  Standards 


Follow-up  Employment  Rate 
Welfare  follow-up  Employment  Rate 
Follow-up  Weekly  Earnings 
Welfare  Follow-up  Weekly  Earnings 

Youth 

Entered  Employment  Rate 
Eiiq>loy ability  Enhancement  Rate 

State  Performance  Standards 

Adult  t  Youth 

Welfare  Recipients  Enrolled 
As  a  Percentage  of  Total 
Enrollment 

Adult 

Wage  at  Placement  As  a 

Percentage  of  Adult  Hon -Wei fare 
Clients  Wage  at  PlacesKnt 


State 
Standard 

RMCEP 

Actual 

Performance 

State 

Actual 

Performance 

60. 4Z 
S3.4Z 
$235 
$236 

78. 4Z 
77. 5Z 
$249 
$249 

68. 2Z 
65. 4Z 
$266 
$260 

49. 2Z 
28. 2Z 

73. 5X 
45. 6Z 

55. 3Z 
43.  IZ 

49. 5Z 


90.  OZ 


54. 8Z 


96. IZ 


58. 8Z 


99.  OZ 


These  outcoae*  were  achieved  while  serving  hard-to-serv«  individuals.  S^ 
Welfare  recipients  are  one  of  the  groups  designated  as  herd-to-serv*  under 


^ 


227 


the  1992  JTPA  amendments.  Welfare  recipients  made  op  58. 8X  of  the  JTPA  IIA 
participants  in  PY  1991.  Currently  70X  of  RMCEP's  adult  participants  fit 
into  one  or  nore  of  the  hard  to  serve  categories  included  in  the  JTPA  amend- 
nents. 

Rural  Minnesota  CEP's  policy  is  to  serve  econoaiically  disadvantaged 
individuals  who  need  assistance  to  obtain  employment.  Rather  than  fit 
people  into  boxes,  staff  look  at  need,  motivation  and  commitment  %rlth  an 
emphasis  on  need. 

Issue  2;  LONG  TERM  BENEFITS 

Individuals  who  participate  in  RMCEP's  Employment  and  Training  Program 
realize  several  benefits. 

o  Adult  participants  who  left  the  program  for  employment  in  Program 
Year  1991  were  paid  $260  per  week  when  surveyed  for  follow-up 
data.  As  a  starting  wage  this  compares  favorably  with  average 
weekly  wages  of  all  employees  in  the  nineteen  counties  of  Ser- 
vice Delivery  Area  2  which  ranged  from  $289.89  per  week  to 
$386.93  per  week  in  the  fourth  <iuarter  of  1991. 

o  Of  those  participants  who  left  the  program  for  employment,  88. 9Z 
were  still  working  thirteen  weeks  later  according  to  survey  re- 
sults . 

o  Participants  %«ho  con^lete  Classroom  Training  or  On- the- Job  Train- 
ing have  marketable  skills  that  will  help  them  secure  and  advance 
on  a  Job. 

o  Participants  who  coaq>lete  Work  Training  gain  basic  work  skills 
and  habits  that  will  help  thea  succeed  at  any  Job. 

o  Participants  in  the  Life  Skills  Workshop  are  better  able  to  cope 
with  pressures  that  could  force  them  to  quit  working. 
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o  Participants  in  basic  education.  GED.  ESL  and  High  School  Diploma 
Programs  increase  their  confidence  and  their  ability  to  access 
further  education  and  training  opportunities. 

Individuals  would  have  great  difficulty  in  achieving  any  of  these 
long- lasting  results  if  not  for  the  help  and  assistance  available  through 
the  Job  Training  Partnership  Act. 

Issue  3:     JTPA  TRAmiNG  AND  PLACEMEHT  ACTIVITIES 

In  Minnesota  Job  Service  and  Service  Delivery  Areas  negotiate  coordina- 
tion agreements  which  include  a  description  of  the  services  \^ich  each 
entity  will  provide.    (Attachment  2) 

Rural  Minnesota  CEP's  charge  is  to  provide  training,  employment  experi- 
ence and  employability  planning  services  to  economically  disadvantaged 
unemployed  people  who  have  barriers  to  employment.  The  mission  of  the  Job 
Service  is  to  bring  people  and  jobs  together  by  helping  businesses  meet 
labor  force  needs. 

The  Rural  Minnesota  CEP  Employability  Development  System  consists  of  a 
series  of  organized  activities  which  promote  a  formal  and  practical  ap- 
proach to  help  participants  secure  employment.  The  activities  in  which 
clients  participate  are  determined  by  the  caaq>letioo  of  a  Needs  Assess- 
ment. The  Needs  Assessment  provides  staff  with  the  information  necessary 
to  evaluate  the  employment  related  needs  of  the  client.  During  the  Needs 
Assessment,  staff  determine  the  skills,  abilities,  training,  work  history 
and  employment  barriers  of  each  client.  After  determining  needs,  an  indi- 
vidual may  enter  one  of  the  following  activities  t 

1.  Career  Planning  System  —  This  coo^onent  was  developed  to  instruct  the 
disadvantaged  uneaqtloyed  in  making  informed  career  decisions.  The 
process  considers  aptitude,  skills,  interests,  lifestyle  needs,  person- 
al barriers  and  labor  surket  possibilities  in  setting  career  goals. 
The  result  of  the  activity  is  a  written  Employability  Development  Plan. 

-■■'■■■  :  ■•■  ?    ..•'■-,■.'.  r  ■■ ::  -sr'  ■  ■ 
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2.  Work  Training  --  Some  applicants  have  never  held  a  job  or  have  an 
inconsistent  work  history.  Work  Training  is  for  them.  Participants 
are  placed  in  well-supervised  worksites  to  learn  basic  employment 
skills  such  as  promptness,  cooperation  with  co-workers,  responsibili- 
ties to  employers  and  dependability. 

3.  Youth- In-Transition  --  This  activity  consists  of  short  term  and/or 
part-time  jobs  for  clients  tdio  are  in  school.  It  provides  students 
with  an  opportunity  to  develop  basic  %«ork  skills  \diile  completing 
their  education. 

4.  On-the-Job  Training  —  Participants  learn  specific  job  skills  in  an 
actual  work  situation.  The  employer  provides  the  training  and  Rural 
Minnesota  CEP  reimburses  the  employer  for  extraordinary  training 
costs.  The  worker  gets  a  job  and  the  employer  gets  an  employee 
trained  to  specifications. 

5.  Adult  Basic  Education  --  Participants  who  require  upgrading  of  read- 
Ing,  communications  and  math  skills  are  enrolled  in  adult  basic  educa- 
tion programs  operated  by  local  school  districts. 

6.  General  Equivalency  Diploma  —  Dropouts  prepare  for  the  GED  test  with 
local  education  agency  providers. 

7.  High  School  Diploma  —  Participants  work  toward  a  diplooa  in  •  local 
alternative  education  center,  alternative  program  or  regular  high 
school  program. 

8.  English  as  a  Second  Language  --  Individuals  whose  primary  language  is 
not  English  participate  in  ESL  classes  through  local  education  agen- 
cies. 

9.  Classroom  Training  —  Occupational  skill  classroom  Instructioa  Is  also 
available  to  participants  in  cooperation  with  existing  post-secondary 
schools.  Tuition,  books,  and  supplies  are  provided  by  Rural  Minnesota 
CEP.     Supportive  services  are  also  avellablm. 
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10.  Job  Search  System  --  This  three  week  training  activity  includes  a  five 
day  workshop  in  which  participants  are  taught  how  to  access  the  hidden 
Job  market  for  job  openings,  prepare  a  good  resume,  perform  well  at 
interviews,  keep  a  job  once  they  get  it,  leave  a  job  that  is  not  work- 
ing out,  and  start  the  process  again  if  necessary.  Staff  then  monitor 
the  implementation  of  these  skills  for  two  weeks.  RMCEP  thtis  gives 
people  the  lifetime  skills  for  staying  employed. 

11.  Life  Skills  --  Many  hard-to-serve  clients  lack  the  confidence  and 
knowledge  necessary  to  deal  with  the  complexities  of  modem  society. 
In  Life  Skills  participants  learn  techniques  to  take  control  of  their 
personal  lives.  This  activity  includes  sections  on  personal  growth, 
stress,  self-esteem,  positive  thinking,  trust,  aloneness,  values, 
change,  decision  making,  budgeting  and  parenting.  Helping  individuals 
gain  control  of  their  lives  improves  the  likelihood  that  they  will 
stay  employed. 

12.  Youth  Competency  System  --  Youth  are  screened  in  three  areas:  Pre-Em- 
ployment/Vork  Maturity  Skills,  Basic  Education  Skills  and  Job  Specific 
Skills.  Should  the  initial  screening  indicate  that  a  youth  oiay  b« 
deficient  in  an  area,  further  evaluation  is  conducted  using  CASAS 
pre-assessment  instniments.  Youth  who  require  upgrading  in  two  of  the 
three  competency  skill  areas  participate  in  the  Youth  Competency  Sys- 
tem. A  plan  is  developed  outlining  Rural  Minnesota  CEP  activities  in 
which  participants  can  obtain  those  skills.  Any  or  all  of  the  activi- 
ties described  previously  might  be  utilized.  Youth  are  awarded  Certif- 
icates of  Competency  for  each  of  the  three  skill  areas  in  which  they 
reach  a  satisfactory  level  of  performance  as  determined  by  the  CASAS 
post-assessment.  In  the  Pre-Eiiq>loyability/Vork  Maturity  Skills  area, 
that  level  is  defined  as  achieving  the  eleven  core  competencies.  In 
Basic  Education  Skills  youth  \Axo  test  at  or  above  the  eighth  grade 
level  are  considered  competent.  In  Job  Specific  Skills,  youth  nut 
obtain  at  least  90Z  of  the  skills  needed  for  the  job. 

13.  Supportive  Services  are  provided  to  participants  on  an  as-needed  ba- 
sis. These  could  include,  bat  not  be  limited  to  testing  fees,  licens- 
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Ing.  child  car«,  transportation,  appropriate  clothing,  tools  and  sub- 
sistence needed  to  continue  in  training  or  obtain  employment. 

While  the  Job  Search  System  and  Job  Placement  are  options,  they  are 
normally  utilized  by  participants  who  have  completed  some  other  activity 
such  as  Classroom  Training.  Participants  who  are  Job  ready,  whether  eligi- 
ble or  not.  are  referred  to  Job  Service  for  Placement  Services.  Services 
provided  to  participants  in  the  Job  Search  System  and  Job  Placement  activi- 
ty are  unavailable  through  Job  Service  in  Service  Delivery  Area  2.  A  limit- 
ed number  of  economically  disadvantaged  individuals  who  need  the  training 
offered  in  the  Job  Search  System  to  find  a  good  job,  may  be  enrolled  in 
that  activity  only.  In  PY1991  only  75  of  2,396  participants  were  in  J38 
only,  while  in  PY1992  only  34  of  the  1,781  participants  served  to  date  have 
been  in  JSS  only.  Also,  a  small  number  of  economically  disadvantaged  indi- 
viduals who  have  a  real  need  for  supportive  services  for  items  such  as 
clothes,  tools,  or  relocation  assistance  in  order  to  become  employed  may  be 
enrolled  in  the  Job  Placement  activity  only. 

Over  73Z  of  our  current  program  participants  have  received  services  in 
2  or  more  activities  during  this  program  year.  Over  40Z  of  the  partici- 
pants in  only  one  activity  have  been  in  Classroom  Training,  OJT  or  Work 
Training.  This  is  in  addition  to  a  Needs  Assessment  and  participation  in 
the  Employability  Development  System.  This  is  an  increase  in  service  lev- 
els from  PY1991. 

The  increase  has  occurred  as  BMCEP  has  begun  to  owve  to  providing  more 
services  to  harder-to-serve  individuals  in  response  to  state  and  federal 
oiandates  and  priorities.  RMCEP  is  concerned  that  prohibition  on  providing 
stand  alone  Job  search  will  leave  a  service  gap.  People  tifao  have  skills 
and  need  Jobs  may  not  be  able  to  find  good  employment  because  they  do  not 
know  how  to  look  for  work.  The  economically  disadvantaged  are  isolated  and 
lack  the  connections  others  use  to  secure  good  Jobs.  Even  graduates  of 
post-secondary  institutions  and  experienced  workers  flounder  because  they 
lack  Job  seeking  skills  and  connections.  How  sad  it  is  that  someone  could 
remain  disenfranchised  because  they  lack  clothing  for  work,  tools,  transpor- 
tation or  relocation  assistance.   Ohder  new  regulations,  RMCBP  will  b* 
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unable  to  serve  these  Individuals  until  after  they  have  became  hard-to- 
serve  and  require  costly  intervention  rather  than  cost-effective  prevention. 

Issue  4:   ON-TBE-JOB  TRAINING  CONTRACTS 

During  this  program  year.  Rural  Minnesota  CEP.  Inc.  contracted  with 
187  local  businesses  to  train  and  employ  263  people.  On  an  average,  this 
is  1.4  contracts  per  employer.  Last  year  we  cootracted  with  252  eiiq>loyer8 
to  place  311  OJT  trainees  which  averages  to  1.23  contracts  per  employer. 
The  employer  imist  contribute  50Z  or  more  of  the  OJT  trainee's  wages,  pro- 
vide the  same  benefits  as  available  to  other  employees,  and  accept  responsi- 
bility to  provide  specific  training  as  designed  in  the  contract. 

Ve  do  not  use  OJT  as  frequently  as  we  use  classrooa  vocational  train- 
ing for  our  participants  because  it  is  time  intensive  to  design  and  monitor 
a  customized  training  program.  However,  some  of  our  participants  have  sore 
success  in  this  direct  hands-on  training  activity  and  participants  are 
immediately  earning  a  wage. 

OJT  trainees  are  closely  monitored  to  assure  that  they  are  learning 
the  job  tasks  as  outlined  in  the  contract  and  that  sufficient  intervention 
has  occurred  to  address  major  barriers  to  otaintaining  eiiq>loyBent.  Good 
client  service  practices  encourage  us  to  work  with  employers  who  are  will- 
ing to  invest  in  training  and  vho  are  sensitive  to  the  needs  of  the  popula- 
tion which  we  serve.  Ve  have  a  provision  to  not  pay  contracts  lAen  train- 
ing has  not  been  delivered  as  designed.  Because  our  job  developers  main- 
tain relationships  with  employers  in  specific  areas,  v  are  able  to  identi- 
fy eoiployers  who  have  a  problem  retaining  OJT  trainees.  Adeinistrative 
oversite,  record  keeping  and  follow-up  statistics  also  assist  us  to  wort  ia 
partnership  with  employers  who  are  seeking  long  term  benefits  froa  the 
investment  in  human  capital  rather  than  a  short-term  econonic  boost. 

Issue  5t   REMEDIAL  EDOCATIOK  MAHDAn 

In  1987.  Rural  Minnesota  CEP  assembled  a  task  force  of  members  froa 
the  Private  Industry  Council,  administration  and  teachers  froa  local  edaca- 
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tion  districts,  and  employment  and  training  personnel  to  develop  guidelines 
for  a  literacy  program.  Literacy  Training  is  an  enrichment  program  de- 
signed to  prevent  the  loss  of  grade  level  often  experienced  by  "at-risk" 
youth  during  the  summer  months.  As  part  of  their  work  week,  youth  in  this 
component  received  remedial  instruction  in  math  and  reading.  The  Sunmer 
Youth  Literacy  Training  Program  has  operated  for  the  past  six  years. 

Local  school  districts  provide  Literacy  Training  under  contract  with 
Rural  Minnesota  CEP.  Youth  are  identified  by  the  local  schools  as  in  need 
of  Literacy  Training  based  on  academic  performance  or  standardized  test 
scores  which  indicate  that  the  student  is  functioning  below  8th  grade  compe- 
tency or  at  two  grade  levels  below  an  age  appropriate  level.  A  pre  and 
post  test  is  administered  to  provide  documentation  of  program  effort. 

Last  sunmer.  Rural  Minnesota  CEP.  Inc.  contracted  with  32  school  dis- 
tricts and  cooperative  educational  districts  to  provide  remedial  education 
in  reading  and  math.  Those  school  districts  and  teachers  that  participated 
in  Summer  Youth  Literacy  Training  provided  excellent  and  often  innovative 
instruction  in  mathematics  and  reading.  Their  efforts  and  commitment 
helped  make  this  Summer  Youth  Program  successful. 

Program  success  in  average  gains  in  literacy  levels  are  as  noted: 

Math 

.98 
.83 

.9 
1.1 
.36 

*  The  numbers  of  youth  participating  in  Literacy  Training  is  a  cooibina- 
tloa  of  IIB  and  MYP. 

This  indicates  a  slight  gain,  but  sore  importantly,  tb«  scores  indi« 
cate  that  the  prograai  is  successful  in  its  objective  to  maintain  grade 
level.   In  addition.  S9Z  of  the  youth  in  the  program  last  suaaer  received 
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Year 

*Participants 

Readinft 

1992 

339 

.39 

1991 

327 

1.12 

1990 

317 

1.0 

1989 

314 

.9 

1988 

174 

1.1 

1987 

130 

.. 
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Rural  Minnesota  CEP  has  aade  consistent  effort  to  aeet  the  remedial 
education  needs  of  the  youth  In  training  with  us  for  the  future  workforce. 
In  addition  to  the  federal  suaner  program,  resources  were  provided  by  the 
State  funded  Minnesota  Youth  Program. 

Issue  6:   SUMMER  YODTB  PROGRAM  SUFERVISIOH 

Rural  Minnesota  CEP  operates  a  quality  Suraner  Youth  Program.  Ve  accom- 
plish this  because  we  see  the  value  In  training  the  staff  people  who  will 
be  the  contact  person  for  the  youth  and  the  worksite  supervisors.  In  turn, 
RMCEP  stunner  staff  provide  training  to  worksite  supervisors  on  program 
goals,  regulations,  safety,  and  mentoring.  Sumner  staff  also  provide  the 
youth  participants  with  an  orientation  to  the  world  of  work.  Included  in 
this  training  is  an  emphasis  on  meaningful  work. 

Last  sunner,  participants  in  the  Summer  Youth  Program  were  placed  at 
worksites  which  were  well  supervised  and  provided  meaningful  work. 
Worksites  were  developed  primarily  with  government  and  non-profit  enti- 
tles. Every  effort  was  made  to  assure  that  youth  had  an  opportunity  to 
apply  for  jobs  within  their  sphere  of  Interest  and  ability.  Many  of  the 
Jobs  also  gave  youth  an  opportunity  to  improve  their  communities.  The 
communities  in  our  rural  19  county  area  count  on  the  youth  workers  to  con- 
tribute their  time  and  talents  to  conmunity  improvement  projects  as  crew 
workers  or  aides  in:  county  and  city  park  departments,  community  recrea- 
tion programs,  tourist  information  centers,  senior  nutrition  centers,  city 
street  departments,  county  museums  and  libraries,  county  and  city  govern- 
ment offices,  local  schools,  recycling  centers,  and  natural  resource  agen- 
cies. Public  sector  jobs  were  fully  subsidized.  On-the-Job  Training  con- 
tracts, which  reimbursed  the  employer  up  to  50Z  of  the  wages  for  training 
costs  Incurred  %rere  administered  for  private  sector  worksites.  Both  public 
and  private  worksites  helped  youth  develop  skills  and  obtain  experlenc* 
that  will  prove  Invaluable  when  they  leave  school  and  enter  the  workforce. 

Rural  Minnesota  CEP  staff  frequently  contacted  both  the  youth  and 
worksite  supervisor  to  assure  our  mission  for  the  programs  a  safe  and 
productive  work  eiqterlence  for  the  youth.   Program  dose-oat  reports .  froa 
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the  summer  staff  emphasized  the  excellence  In  worksite  supervision  and 
contended  supervisors  for  their  dedication  to  yoting  people. 

Work  Training  activity  is  the  vehicle  for  one  of  our  PIC  recomnenda- 
tions:  encourage  mentoring  of  youth  participants.  The  %rarksite  supervi- 
sors are  encouraged  to  form  a  mentoring  relationship  with  the  youth.  This 
concept  is  introduced  to  the  supervisors  at  a  pre-placement  training  ses- 
sion. The  Summer  Youth  staff  program  evaluations  provided  these  observa- 
tions about  mentoring: 

"special  effort  that  we  made  was  to  work  with  the  supervisors  in  terms 

of  training  them  to  be  mentors  to  the  youth.  Many  of  the  supervisors 

did  a  lot  of  this  on  their  own  and  already  saw  it  as  one  of  their 
primary  functions." 

"It  was  a  pleasure  for  us  to  see  the  mentoring  that  was  taking  place 
at  some  of  the  worksites.  We  compliment  these  supervisors  for  taking 
the  risk  of  assisting  the  kids  in  their  personal  life  and  teaching 
them  skills  and  work  habits  that  will  enable  then  to  succeed  in  the 
%forking  world." 

"I  felt  the  majority  of  the  worksites  were  excellent  as  well  as  the 
supervisors  being  good  role  models  as  well  as  mentors.  I  had  a  great 
deal  of  youth  clients  talk  favorably  about  their  worksites  as  well  as 
their  supervisors." 

Comments  from  youth  participants  reinforce  the  value  of  the  supervisor 
as  mentor  relationship:  "I'm  glad  I  got  the  chance  to  work  for  ny  supervi- 
sor. He  was  greatll"  "Boss  was  cool.  %rould  like  to  work  for  him  next 
summer."  "It  has  made  ay  life  different."  "Great  worksite  and  supervi- 
sors I* 

Our  work  training  activity  is  flexible  to  meet  the  needs  of  the  youth 
and  the  worksite  supervisor.  Flexibility  is  Important  also  to  accoonodate 
the  literacy  needs  of  the  youth.  According  to  a  survey  returned  by  the 
youth  participants  In  SYP  last  suaowrt 
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71.33Z  worked  full-tim 

90Z  said  that  their  supervisor  discussed  safety  with  them 
96Z  indicated  that  there  was  enough  work  to  keep  them  busy 
9S.33Z  felt  their  work  was  worthwhile 

77.33Z  of  the  youth  were  working  in  an  environment  where  only  1 
to  3  youth  were  assigned  to  a  supervisor. 

The  low  ratio  of  youth  to  supervisor,  emphasis  on  safety,  and  meaning- 
ful %rork  promotes  an  excellent  youth  program. 

Issue  7:   FUNDS  AND  EFFECTIVENESS 

Section  108  of  Public  Law  97-300  establishes  the  limitation  of  costs 
as  follows: 

Administration  15. OZ  Maximum 

Training  70. OZ  Minimum 

Participant  Support      15. OZ  Maximum 

Section  108(d)  of  Public  Law  97-300  exempts  Concentrated  Employment 
Programs  from  these  limitations. 

Although  exempt  froa  JTPA  cost  limitations,  RMCEP  has  always  striven 
to  meet  the  goals  established  in  the  law.  (See  chart  below).  The  difficul- 
ty of  operating  a  good  program  which  meets  federal  requirements  with  only 
15Z  of  the  budget  devoted  to  administration  was  acknowledged  in  the  1992 
JTPA  amendments  vhich  now  allow  20Z,  and  in  some  instances  23Z.  of  the 
funds  to  be  used  for  administration. 


S  Ti''^  ^  ' 


14 


237 


Three  Ye*r  Comparison  of  Cost  Categories  for  RMCEP 


Wi   It  allocating  SOX  of  Work  Experience  expenditures  to  the  TRAINING  cost  category. 

Fiscal  Year  Ending  Fiscal  Year  Ending  Fiscal  Year  Ending 
JTPA  Title  II-A         6-30-90  6-30-91  6-30-92  TOTALS 


Administration        634.014   13. 9Z      631.310   16. 8Z      497,891   14. 9Z     1.763.413   13. 9Z 
Training  2.319.423  SS.OZ    2,196.332  38. 6Z    1.970,113  39. OZ     6,483,870  38. 3Z 

Part.  Support       1.044.747  26. IZ      922.068  2<>.6Z      869.477   26. IZ     2,836.292  23. 6Z 


Total  3.998,184  3,749,910  3,337,483  11,083.377 

Section  108(b) (2) (A&B)  allows  for  the  allocation  of  30Z  of  work  experi- 
ence expenditures  to  the  TRAINING  cooponent  if  the  Work  Experience  is  less 
than  6  months;  prohibition  from  future  Work  Experience;  this  activity  is 
coupled  with  other  training  activities;  and  the  wages  paid  do  not  exceed 
the  prevailing  entry  level  wage  rate. 

Allocating  30Z  of  Work  Experience  expenditures  to  the  TRAINING  cost 
category. 

Fiscal  Year  Ending  Fiscal  Year  Ending  Fiscal  Year  Ending 
JTPA  Title  II-A         6-30-90  6-30-91  6-30-92  TOTALS 


Administration       634.014  13. 9Z      631.510  16. 8Z      497,891  14. 9Z     1.763.413  13. 9Z 
Training  2.703.611  67. 6Z    2.338,393  67. 7Z    2.264.833  67. 9Z     7.307.041  67. 7Z 

Part.  Support        660.539  16. 3Z      379.805  13. 3Z      374.757  17. 2Z     1.813,121  16. 4Z 


Total  3,998.184  3,749,910  3.337.483  11,083,577 


JTPA  is  an  accountable  program.  Independent  audits  performed  by  certi- 
fied Public  Accountants  are  on  file  for  Rural  Minnesota  CEP's  programs. 
The  program  is  also  monitored  by  the  State  of  Minnesota  and  written  documen- 
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tation  is  maintained.  Audit  reports  and  State  aonitoring  reports  are  avail- 
able. 

Federal  requirements  vrtiich  contribute  to  the  costs  for  administration 
include  maintaining  required  audit,  accotinting,  data  collection,  affirma- 
tive action,  monitoring,  grievance  and  other  procedures  vdiich  are  not  with- 
out cost. 

Still,  as  shown  in  the  table  below,  all  SDAs  in  Minnesota  in  the  pro- 
gram year  ending  June  30,  1992  were  within  the  limitations.  Procedures  for 
assigning  costs  have  been  approved  by  the  State  of  Minnesota  and  their 
appropriateness  verified  by  independent  audit  of  individual  SDAs. 


State 

of 

Minnesota 

Total  Expenditures 

13,  457.663 

Administration 

Training 

Support 

2,271,061 

10,885.907 

2,300,697 

14. 7X 
70. 4Z 
14.92 

When  considering  cost  effectiveness  one  would  have  to  compare  the  cost 
of  the  Investment  in  training  to  the  cost  of  lost  wages,  welfare  payments, 
lost  taxes,  unrealized  potential,  lower  productivity,  and  human  suffering. 
Although  I  cannot  analyze  the  costs  of  the  latter  I  believe  the  investment 
in  RMCEP  JTPA  clients  of  less  than  |2,000  per  participant  is  cost  effective 
^en  compared  to  the  costs  of  the  alternative. 


JTPA/LGB 
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Buxxl  HinnesocA  CSS,  Inc.  Serric*  Area 


AttacbKiit  1 


240 


/^■h9^cKr*^^  ?- 


Participant  Characteristics 


Rural  Minnesota  CEP  has  an  ongoing  coaunitment  to  serving  welfare  recipi- 
ents. In  PY'91  1,614  clients  participated  in  the  JTPA  IIA  Adult  Program  of 
whom  56. 9X  were  welfare  recipients.  The  JTPA  IIA  Youth  Program  had  782 
enrollments  of  whom  50. If  were  welfare  recipients.  It  is  estimated  that 
10.31  of  the  eligible  population  were  receivuig  Public  Assistance  during 
the  program  year.  Welfare  recipients,  however,  made  up  54. 8X  of  the  agen- 
cy's enrollment.  Welfare  recipients  not  only  were  enrolled  at  a  much  great- 
er rate  than  their  incidence  in  the  eligible  population,  but  required  a 
larger  proportion  of  the  resources  to  be  adequately  served.  Rural  Minneso- 
ta CEP  recognizes  the  needs  of  this  hard  to  serve  group,  and  will  continue 
its  commitment  to  make  welfare  recipients  a  priority  for  services. 


PARTICIPANT  CHARACTERISTICS  SUMMARY 
PY"91  llA  ADULT  &  YOUTH  PROGRAMS 


Actual 

Planned      i 

Actual 

Planned 

Substantial 

Level  of 

Uvel  of     1 

Hard  to 

Uvel  of 

Uvel  of 

Segments 

Service 

Service       1 

Serve 

Service 

Service 

Female 

55. OX 

50. OX 

Adult  Dropout 

7.9X 

13. OX 

Youth  Dropout 

4.6X 

7.6X 

t.-uk 

0.6X 

0.2X 

Hispanic 
Native  American 

1.3X 

0.7X 

Food  Stamp 

51.3X 

30.0X 

11.2X 

9.0X 

St.  Public  Assis. 

54.8X 

50.0X 

Asian 

0.3X 

0.4X 

AFDC 

34.4X 

31 .5X 

Work  Readiness/GA 

21. 4X 

18. SX 

16-17 

6.2X 

6.5X 

Refugee  Cash  Ass. 

o.ox 

O.IX 

18-21 

26.7X 

24. 9X 

22-39 

51.  IX 

51. OX 

UC  Recipient 

4.9X 

4.6X 

40-54 

13.9X 

14. OX 

Homeless 

1.6X 

0.3X 

"55* 

5.  IX 

3.6X 

Handicapped 

12.9X 

12.0X 

Long-Term  Unemployed  20. 3X 

• 

Chem.  Dependent 

10. 2X 

a 

1         Low  Reading  Skills 

7.9X 

• 

1        Offenders 

10.9X 

• 

1        At  Risk  Youth 

17.2X 

• 

*  Not  Planned 
*•  Includes  JTPA  3X  Older  Worker  Program 


Appendix  2. — Questions  for  the  Record,  Submitted  by 

Mr.  Machtley 


RONALD  K    MACHr_£Y 
1ST  District.  fb<O0E  li-^^c 

COMMITTEE  ON  ARMED  SERVICES 

COMMITTEE  ON  SMALL  EASINESS 

COMMITTEE  ON  GOVERNMENT  OPERATIONS 


SELECT  COMMITTEE  ON  C-ILDPEN 
YOUTH.  AND  FAMILES 


C(M:mAIA.  new  ENGLAJIO  EMEffc*  CAUCUS 


CONGRESSIONAL  HUMAN  NlG*<n  :aUCU$ 
CONGRESSIONAL  TEXTILE  CAUCUS 


CONGRESSIONAL  NOTCH  COA-nON 


Congress  of  the  lEnited  ^States 

tnoQ5E  of  ReprEsmtatiDcs 
Washington,  B£  205i5-)qoi 


May    18,     1993 


The   Honorable   Collin   C.    Peterson 

Chairman 

Subcommittea  on  Employment,  Housing,  and  Aviation 

B-349  A  Raycurn  House  Office  Building 

Washington,  DC  2Q515 

Dear  Mr.  Chairman: 

Thank  you  for  calling  the  April  29  hearing  to  review  the  Jor 
Training  Patrtnership  Act.  I  found  the  testimony  from  the  witnesses 
very  revealing  and  I  look  forward  to  continuing  the  subcommittee's 
oversight  of  federal  job  training  programs. 

Enclosed  please  find  a  copy  of  a  letter  I  wrote  to  Secretary 
of  Labor  Robert  Reich  which  contains  questions  I  would  like  tc 
Labor  Department  to  answer  for  the  hearing  record.  I  would  alsc 
like  to  have  this  letter  and  the  Labor  Department's  reply  submitted 
for  the  official  hearing  transcript  for  the  April  29,  1993  hearing- 

Again,  theink  you  for  calling  this  hearing.  I  look  forward  tc 
continuing  to  work  with  you.  If  you  have  any  gaestions  regarding 
this  letter,  please  contact  myself  or  Mike  Nannini  at  5-9026. 


/^t/^'^r' 


FMacatrey 
Ranking  Minority  Member 
Subcommittee  on  Employment, 
Housing,  and  Aviation 
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RONALD  K   MACHTLEY 

1ST  DtST«in     RnOOl   I^ANO 

COMMrlTEE  ON  ARMED  SERVICES 

COMMITTEE  ON  SMALL  BUSINESS 

COMMITTEE  ON  GOVERNMENT  OPERATIONS 


SELECT  COMMITTEE  ON  CHILDREN. 
YOITTH.  AND  FAMILIES 


CO^NAR.  mVm  tMGLAMO  IHaCV  CAUCUS 


COMCnOSKMAX  HUMAN  NiGMTS  CAUCUS 
COftSHUaMfUtL  TUTul  CAUCUS 


coMaiusKmAi  notch  coautiom 


Congress  of  the  "Enircd  States 

^oDst  of  Tlqjrcsntairocs 
Washington,  BC  :u')ij-)9oi 


13:  1*NN0«<  -OJS  orftCt  tUllOlHC 

VASMiNO   zz  I0»>S-J90I 

I2C3  ZZS-ti  1 1 


IOC  «*^^  STREIT 

s--i :30 

l«0-    -3-S400 


3}0  T    lif-  STRICT 

NIW*:^  «  031*0 
t«D'   »4-TSI0 


Kay    18,    1993 


The  Honorable  Robert  B.  Reich 

Secretary 

United  States  Department  of  Labor 

200  Constitution  Avenue,  NW 

Washington,  D.C.   20210 

Dear  Mr.  Secretary: 

Thank  you  for  sending  Deputy  A^istant  Secretary  David  O. 
Williams  to  appear  before  the  HoEse  Government  Operations 
Subcommittee  on  Employment,  Housing,  and  Aviation  to  testify  on 
behalf  of  the  U.S.  Department  of  Labor  at  the  hearing  held  on  April 
29,  1993.  I  appreciate  the  Labor  Department's  participation  ijo 
this  hearing  and  look  forward  to  working  with  you  in  the  future. 

In  the  written  testimony  submitted  by  Mr.  Williams,  he  made 
reference  to  your  efforts  to  conduct  a  review  of  Federal  job 
training  programs.  Specifically,  Mr.  Williams'  written  testimony 
states,  on  pages  12-13,  that  "Secretary  Reich  is  undertaking  a 
review  of  Federal  job  training  procrams,  including  JTPA,  to 
determine  the  programs  and  strategies  that  work  and  those  that 
don't." 

In  response  to  the  questions  listed  below,  please  provide 
further  information  regarding  your  review  for  the  April  29  hearing 
record. 

1)  Describe  in  detail  the  scope  of  the  Labor  Department's 
"review"  of  federal  job  training  programs.  What  specific 
programs  are  subject  to  the  review? 

2)  Have  any  working  groups,  task  forces,  or  commissions  of  any 
type  been  created  by  the  Labor  department  to  conduct  this 
review? 

3)  If  yes,  please  submit  a  list  of  all  Labor  Department  employees 
who  work  for  or  are  assigned  to  thsse  groups,  including  their 
name,  their  title,  and  the  division  within  the  Labor 
Department  to  which  they  are  assigr.ad. 


it^* 


243 


The  Honorable  Robert  B.  Reich  —  =ge  2 

4)  If  the  aforementioned  groups  .lava  been  establisiad,  are  any 
non-federal  or  private  secr=:r  persons  assigned  to  these 
groups? 

5)  If  yes,  please  submit  a  list  i=  all  private  sector  persons  who 
work  for  or  are  assigned  to  — ess  groups,  includir.g  their 
name,  their  title,  and  their  business  address. 

6)  If  the  aforementioned  groups  :ava  been  establis'-ed,  have  you 
or  any  other  Labor  Departiant  employee  provided  written 
guidance  to  the  group(s)? 

7)  If  yes,  please  submit  a  copy  if  any  written  guidance  provided 
to  the  group (s) . 

8)  Is  this  review  associated  wim  Tice  President  ilbert  Gore's 
National  Performance  Review? 

Please  submit  your  responses  to  these  questions  by  June  4, 
1993.  If  you  have  any  questions  regarding  this  request,  please 
contact  Michael  Nannini  of  the  sub=mmittee  at  225-9026.  Thank  you 
for  your  attention  to  this  request. 


U&JT 


rAi  Machtlty 
Ranking  Minority  Member 
Subcommittee  on  Dnployment, 
Housing,    and  Aviation 
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U.S.  Department  of  Labor 


Employment  and  Trainnvj  Administration 
200  Constitution  Awenuft  N.W. 
Washington.  DC.  20210 


.7 


The  Honorable  Ron  Machtley 
Ranking  Minority  Member 
Subcommittee  on  Employment,       '^ 
Housing,  and  Aviation 
U.S.  House  of  Representatives 
Washington,  D.C.  20515 

Dear  Congressman  Machtley: 

Thank  you  for  your  letter  to  Secretary  Reich  requesting 
information  on  the  Department  of  Labor's  review  of  federal  job 
training  programs. 

The  Secretary  is  planning  a  thorough  review  of  job  training 
programs.   However,  these  plans  are  still  being  formulated,  and 
we  do  not  know  at  this  point  how  the  review  will  be  structured. 
I  will  get  back  to  you  when  the  review  plan  takes  shape  and 
address  your  questions. 

Thank  you  again  for  writing  to  the  Secretary.   Please  feel  free 
to  call  me  at  219-8660  if  I  can  be  of  further  assistance. 

Sincerely, 


RAYMOND  J.  UHALDE 

Administrator 

Office  of  Strategic  Planning 

and  Policy  Development 
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